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ABSTRACT 


The  purpose  of  this  thesis  is  to  obtain  the  approximate 
distribution  of  the  ratio  of  the  square  successive  difference  to  the 
square  difference  in  observations  from  a  stationary  normal  Markov 
process.  The  relevant  literature  is  reviewed  in  Chapter  I.  Chapter  II 
is  concerned  with  Daniels’  development  of  the  distributions  of  a 
sample  serial  correlation  coefficient  for  the  linear  Markov  process 
with  known  and  unknown  means.  In  Chapter  III,  following  Daniels’ 
method,  we  obtain  the  approximate  distribution  of  a  slightly  different 
sample  serial  correlation  coefficient.  Chapter  IV  deals  with  the 
distribution  of  the  ratio  of  the  square  successive  difference  to  the 
square  difference  which  is  obtained  from  the  results  of  the  previous 
chapter.  Also  in  Chapter  IV,  we  compare  the  moments  of  this  ratio 
for  the  case  where  p  =  0  with  those  obtained  by  Williams, 
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CHAPTER  I 

INTRODUCTION 


When  analysing  data  that  possess  trends,  these  trends  are 
usually  removed  and  the  remaining  effects  are  studied.  For  this 
purpose  the  method  of  successive  differences  has  been  employed. 
However,  the  effect  of  trend  on  dispersion  must  be  considered  in 
addition  to  determining  if  a  trend  actually  exists. 

The  usefulness  of  the  method  of  successive  differences 
was  first  realized  by  ballisticians  who  were  concerned  with  the 
problem  of  minimizing  several  effects  in  measuring  the  dispersion 
of  the  distance  travelled  by  a  shell.  The  first  to  use  this  method 
was  Vallier  (  14).  In  later  papers  this  and  related  problems  were 
discussed. 


Von  Neumann  et  al  (  9 )  mentioned  that  the  mean  square 
successive  difference  52  ,  where 


n-1 

Z  ( x .  .  —  x.y 

.  i  i+l  i' 

i=l  

n  -  1 


may  be  employed  to  estimate  the  standard  deviation  so  as  to  minimize 
the  effects  of  the  trend  on  dispersion.  Also,  by  testing  S2 
against 

Z  (x.  -  x)2 
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which  measures  the  variance  disregarding  the  order  of  the  observations 
and  hence  including  any  trend  effects  present,  it  may  be  determined  if 
a  trend  actually  exists  or  not.  In  this  paper  they  discussed  the 
distribution  of  82.  They  assumed  that  the  samples  were  drawn  from  a 
normal  population. 

In  2  later  papers,  von  Neumann  (lO),(ll)  studied  the  ratio 


Here,  as  before,  the  samples  were  taken  from  a  normal  population. 

He  discussed  a  more  general  distribution  of  which  that  of  T]  was  a 
special  case. 

J.  D.  Williams  (  16)  obtained  the  moments  of  rj  by  using 
generating  functions.  Like  von  Neumann  and  others,  he  assumed  the 
samples  to  consist  of  independent, normal  random  variables, 

xl>  0,0 ’  Xn* 

The  stochastic  process, 

x  =  p  x  1  +  zo  ,  (s  =  1,  2,  ...,  n)  ,  J  p |  <1  , 

where  p  is  the  serial  correlation  coefficient,  has  been  discussed, 
by  Koopmans  (5).  The  {zg}  are  assumed  to  be  independent,  N(Q,  cr2) 
random  variables.  As  noted  by  Dixon  (  3  ),  Koopmans  has  shown  that  it 
is  sufficient  to  know  the  distribution  of 

n-1 

2  (x.  -  x)(x.  .  -  x) 

i_l  i  i+l  ' 

2  (x.  -  x)2 

i-1  1 

to  test  the  hypothesis  that  p  =  0. 
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Several  results  on  successive  difference  estimation  including 
significance  tests  were  obtained  by  Tintner  (13).  In  one  of  these 
tests,  selected  sets  of  differences  were  used, 

Morse  and  Grubbs  (  8 )  considered  the  estimation  of  variance 
by  the  use  of  successive  differences  of  order  greater  than  one.  They 
felt  that  this  method  would  be  valuable  in  cases  where  the  type  of 
trend  is  unknown. 

It  was  noted  by  Morse  and  Grubbs  that  the  theory  of 
successive  differences  and  the  problem  of  serial  correlation  are 
related,  Dixon  [(  3);  page  119]  states,  ,rThe  development  of  the 
distribution  theory  and  significance  criteria  [of  serial  correlation 
coefficients]  was  retarded  by  the  fact  that  the  successive  differences 
or  successive  products  of  statistical  variates  are  not  independent,” 

A  lot  of  these  difficulties  have  been  overcome  and  we  are  able  to 
study  the  distributions  of  serial  correlation  coefficients  and  the 
theory  of  successive  differences  more  extensively, 

A  circular  definition  of  the  serial  correlation  coefficient 
was  suggested  by  Hotelling.  By  using  such  modified  statistics, 
further  progress  in  developing  the  distribution  theory  was  made  by 
others  such  as  R.  L.  Anderson,  Dixon,  Koopmans  and  Madow.  As  noted 
by  Daniels  [(  2),  page  I69],  "The  exact  distribution  is  known  for 
the  circular  coefficient  of  any  lag  from  an  uncorrelated  normal 
process  and,  more  generally,  from  a  circularly  modified  normal 
process  of  autoregressive  type,  Quenouille  (19^9)  obtained  by 
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the  same  method  the  exact  joint  distribution  of  circular  coefficients 
of  different  lags." 

R.  L.  Anderson  (  1  )  obtained  the  exact  distribution  of  r 
for  the  null  case  (p  =  0),  where 

X1  X2  +  *•*  +  ^  X1 
r  =  - 

Xj2  +  ,.o  +  ^ 

is  an  estimate  of  the  serial  correlation  coefficient,  p  ,  in  a 
circular  universe.  Since  the  exact  distribution  is  complicated, 
Koopmans  (5  )  found  a  definite  integral  and  Dixon  (  3 )  an  explicit 
expression  for  an  approximate  distribution  of  r  for  p  =  0.  These 
results  were  shown  to  be  equivalent  by  Rubin  (12).  Madow  (7  )> 
using  results  of  this  work,  extended  Anderson's  results  to  obtain 
the  exact  distribution  of  the  serial  correlation  coefficient  for 
the  non-null  circular  model.  Following  Madow* s  method,  an  approximate 
distribution  of  the  sample  serial  correlation  coefficient  for  the 
case  p  /  0  was  found  by  Leipnik  (6  ).  Daniels  (2  )  employed  the 
method  of  steepest  descent  to  obtain  the  approximate  distribution  of 
the  sample  serial  correlation  coefficient  for  the  circular  and  non¬ 
circular  Markov  processes  with  known  and  unknown  means. 

In  this  thesis  we  will  consider  the  case  of  the  non¬ 
circular  Markov  process  with  known  and  unknown  means.  We  disregard 
the  circular  case  for  it  is  felt  that  it  is  an  artificial  means  of 
studying  a  time  series.  We  review  Daniels*  method  and  work  in 
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obtaining  the  approximate  distribution  of  the  sample  serial  correlation 
coefficient 


where 


c  =  X1  X2  +  • • *  +  X 


n- 1  n 


A.  2  2 

c0  =  2  xi  +  x2  +  . 


2-12 

.  +  X  ,  +  2  X 

n-1  n 


for  the  non-circular  Markov  process.  We  then  use  Daniels*  method  to 
obtain  the  approximate  distribution  of  a  slightly  different 
sample  serial  correlation  coefficient  which  is  defined  as  follows! 


c 


where 

C  =  i  +  X1  Xg  +  ...  +  Xn_x  Xn  +  i  Xna  , 

c0  =  xl2  +  •••  +  *n  • 


This  is  for  the  non-circular  Markov  process. 


From  the  approximate  distributions  of  r  ,  as  defined  in 
the  latter  case,  we  obtain  the  approximate  distributions  of 
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This  is  related  to  the  work  of  von  Neumann  (10),  (ll)  and  Williams  (l6) 
since  is  similar  to  q  for  large  values  of  n  except  that  we 

assume  the  sample  x^,  . . . ,  x^  to  consist  of  serially  correlated 
rather  than  independent,  normal  random  variables.  By  putting  the 
serial  correlation  coefficient  equal  to  zero  (p  =  0),  our 
distribution  is  approximately  the  same  as  that  discussed  by  von 
Neumann  and  Williams  for  large  values  of  n.  The  moments  nv  and 
m^  of 

n-1 

Z  (X.  -  X.)2 

A  j=l  J+1  3 

_  =  -  , 

2  (X.-X)2 

j=l  J 


where  (X^,  . ..,  }  is  a  sample  from  a  normal  population  with  mean 

zero  and  variance  cr2  ,  obtained  by  Williams  are  the  same  as  those 
obtained  by  using  our  approximate  distribution  of  with  p  =  0. 

The  higher  moments  obtained  using  the  probability  density  of 
with  p  =  0  are  approximately  equal  for  large  n  to  those  of  ^ 
obtained  by  Williams. 
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CHAPTER  II 

THE  APPROXIMATE  DISTRIBUTIONS  OF  AN  ESTIMATE  OF  THE  SERIAL 
CORRELATION  COEFFICIENT  FOR  A  NON-CIRCULAR  MARKOV  PROCESS 
WITH  KNOWN  AND  UNKNOWN  MEANS  AS  DEVELOPED  BY  H.  E,  DANIELS 


Linear  Markov  Processes 


Consider  a  subset  of  time  points 


LI  <  L2  <  ***  <  Si 


and  the  random  variables  X(t^)  at  tf*116  t  .  The  joint  distribution 
of  X(tl),  X(tn)  is  denoted  by  pfX^),  X(  )  ] .  We  have 

a  completely  stationary  process  if 

p[X(tx),  X(tn)]  =  ptxttj-r'),  ...  ,  X(tn-  t')] 

for  all  subsets  t^  <  tg  <  ...  <  t^.  That  is,  the  joint  distribution 
is  invariant  under  a  change  of  time  origin.  A  process  is  stationary 
of  order  k  if 

£  [X  1(t]_)  ...  Xn(tn)]  =  £[X  1(t1-T')  ...  X  n(tn-r')] 


for  all  t/  and  all  QL  +  . . .  +  05  <  k  . 

1  n  — 


We  shall  now  consider  the  cases  of  order  one  and  two.  If 
the  process  is  stationary  of  order  one, 


£  [X(t)l  =  &  [X(t  -  T')J  = 


for  all  t\  Thus  the  mean  is  independent  of  time.  If  the  process  is 
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stationary  of  order  two,  we  have 

il  [X^(  t )  ]  =  &  [X2(t  -  rf] 

for  all  rf  and 

£  lx(tL)  x(t2)]  =  x(tg-T')] 

for  all  t'  Then 

Var  [X(  t )  ]  =  £[X2(t)]  -  {£[X(t)]}2 

=  Var  [X(t  -  t')] 

=  cr2 

for  all  t'  That  is,  the  variance  is  independent  of  time0  We  call 
cr2  the  autovariance.  Also, 

Cov[X(tl),  X(t2)]  =fe[X(tl)  X(t2)]  -&[X(tl)]&[X(t2)] 

=  Cov[X(t1-T/),  x(  tg-T')  ] 

=  c(tg-ti) 

for  all  r\  C(tg  -  t^)  is  called  the  autocovariance  and,  as  shown, 
is  independent  of  the  time  origin. 

The  autocorrelation  function  p(t)  is  defined  as! 


p(t)  , 


cr2 
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where  t  =  t0  -  t^  is  the  lag,  p(t)  measures  the  degree  to  which 
variables  at  time  difference  r  are  correlated.  p(t)  is  an  even 
function  of  r.  Also,  it  can  be  shown  that  necessary  and  sufficient 
conditions  for  a  function  to  be  an  autocorrelation  function  are  that 
p(o)  =  1  and  p(t)  is  positive  semi-definite. 

Let  us  consider  the  linear  Markov  process  in  discrete  time 

defined  by 


x  =  p  x  _  +  e 
s  s-1  s 


for  all  s  ,  where  the  constant  p  is  called  the  serial  correlation 

coefficient  and  the  [e  }  are  independently  and  identically 

s 

distributed,  N(0, l)  random  variables.  As  shown  below,  such  a 
process  ultimately  becomes  stationary  if  | p j  <  1. 


If  we  assume  that  the  initial  state  is  x^  then  for 
s  —  1,  2,  ...,  n 


s  s-1  s-2  2 

Ks=px0+p  e1+p  ea  +  ...  +  p  es_2  +  p  es_1  +  es 


Since  &.  (e  )  =0 
s' 


( ®  —  ^-}  ,  ft)  y 


H.  (xs)  =  Ps  x0 


and  this  approaches  zero  as  s  becomes  large  if  |p|  <  1,  Then  the 
process  becomes  stationary  to  the  first  order. 


Since 


fe  (ei2)  =  Var(ei) 


1 
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and 


&  e ,)  =  0  (i  /  j)  > 


we  have 


Var(x  )  =  £l('x2  )  -  [&(x  )]2 


2s 


/l— p  2s  2\  /  s  \2 

( - 2~  +  P  x0  )  -  (p  x  ) 

1-p 


1  -  P' 

1-p 


2s 


If  |  P  |  <  1,  Var(x  )  approaches  — - —  as  s  becomes  large.  Now, 


1-P- 


for  any  fixed  t  >  0 


Cov(x  ,  x  )  =  (x  x  )  -  )i(x  )  ^e(x  ) 

'  s;  S-T7  '  S  S-T  s'  S-T 


n  2(s-t)  0  _ 

t  /1-p  \  .  2s-t  2 


1  / 
P  (- 


1-p' 


\  «C.O-  I  C 

2  )  +  P  *0 


(p\)(PS-\) 


T  fl-P2(S-T\ 

p  (— —2~  } 
1-P 


and  if  |p|  <  1 


Cov(x  ,  x  )  ->  —  as  s  — > 00 

s  s-t  ,  p 

1-p 

Also,  for  any  fixed  t  <  0  r  =  —  | r |  and 


j  |  ,  2s 

COV(V  XS-T}  =  C°v(xs’  *s+|r|)  =  p  T  (7JV) 

1  1  1-p 


and  if  jp|  <  1 


11 


Hence,  if  |pj  <  1  the  process  becomes  stationary  to  the  second 


order  which,  in  the  case  of  a  normal  process,  implies  complete 
stationarity.  In  many  problems  in  which  the  process  has  been  in 
existence  for  a  very  long  time  it  is,  therefore,  realistic  to 
assume  stationarity. 

2.  Saddlepoint  Approximation 

In  the  present  section  we  discuss  section  2  of  Daniels’ 
paper.  Here  and  in  the  subsequent  sections  of  this  chapter  all 
references  to  Daniels  are  to  his  1956  paper  (2).  The  distribution 
of  statistics  of  the  form 


c 


r 


c 


0 


where  c^  is  non-negative,  is  to  be  considered.  We  let  c  ,  c  have 
the  joint  probability  density  f(c  ,c)  and  we  wish  to  find  the 
distribution  of  r  from  this. 


The  Jacobian  of  the  transformation 


c 


r  c 


0 


c 


0 


c 


0 


is 


c 
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Thus  the  joint  probability  density  for  and  r  is 


co  f(co’  r  co)  • 


The  density  for  the  distribution  of  r  can  be  obtained  as  a  marginal 


density  by  integrating  out  to  give 


(2.2,1)  h(r)  = 


co  £(co’  r  co)  d  co 


Let  M(T^,  T)  be  the  joint  moment  generating  function  of 


Cq  and  c.  Then 


T  c _  +  Tc 

M(Tq,T)  =  S(e  °  °  ) 


T  c  +  Tc 

e  f(cQ,c)  d^dc  . 


-00  0 


By  the  Fourier  inversion  formula  we  have 


f(c0,c)  =  — 


(2jti)‘ 


-(T  c  +  Tc) 

M(TQ,T)e  U  d  TQ  d  T  , 


The  paths  of  integration  are  along  the  imaginary  axes  in  the  T^  and 
T  planes  from  -i°°  to  ioo  or  along  any  allowable  deformation  of 
these  paths.  That  is,  along  any  path,  a-i00  to  Ctf+i°o  ,  such  that  no 
singularities  of  M(T^,T)  lie  on  the  new  path  of  integration  or 
between  it  and  the  imaginary  axis.  Since  c  =  r  c(i  ,  we  have 


£(co’  r  co) 


-c0(T0  +  r  T) 

M(TQ,T)e  U  U  d  T0  d  T 
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Considering  the  linear  transformation 


“  =  To  +  r  1  .  T  -  T 


with  Jacobian 


S(TQ,T) 

d(u,  T) 


=  1  , 


it  is  seen  that  this  equation  becomes 


£(c0’r  c0} 


(2rti) 


•  \2 


"cnu 

M(u-r  T,  T)e  du  dT 


The  integration  of  u  is  taken  over  a  path  in  the  u-plane  corresponding 
to  that  of  in  the  T^-plane.  Then 


cou 

£<Vrco)e  d  co  = 


0 


0 


(2rti) 


. 


-cnU 

M(u-rT,T)e  du  dT 


C°U  a 
e  d  c 


0 


p  1  p 


2jti 


i  r  "cou 

—  /  M(u-rT,T)e  du 


Ccu 

e  dc 


0 


Using  the  Fourier  inversion  formula  we  see  that 


0 


i  r  ~cnu 

srr  /  M(u-rT,  T  )e  u  du 

2*1  J 


C°U  a 
e  d  c. 


=  M(u-rT,  T) 


so  that 


CQU 

£(V  r  cQ)  e  d  cQ 


2iti 


M(u-rT,  T)  dT 
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Differentiating,  where  permissible,  under  the  integral  sign  with 
respect  to  u  ,  we  obtain 


00 

/  £(c0’  r  c0)  c0  e  °  d  c0  =  2?I  J  h  tM(u-rT’  T))  dT  • 

6 

Putting  u  =  0  in  this  equation,  we  have,  by  equation  (2.2.1), 


h(r) 


a 

3u 


[M(u-rT, 


T)] 


u=0 


dT 


This  is  equation  (2.5)  of  Daniels’  paper. 

If  we  wish  to  transform  T  to  some  other  variable  z  by 
T  =  T(z,u)  then 


M(u-rT,  T)  dT  =  M[u-rT(z,u),  T(z,u)J  dz  . 


For  simplicity  we  write 


M[u-rT(z,u),  T(z,u)]  —•  (z,u)  dz  =  M(u-rT,T)  dz 

OZ  oz 


Then  we  have 


f(c0’r  co)  e  0  d  co 


stl  /  I  d* 


0 


Integration  is  along  the  transformed  contour  in  the  z-plane.  By 
differentiating  with  respect  to  u  under  the  sign  of  integration  and 
setting  u  =  0  ,  we  obtain 


(2.2.2)  h(r)  = 


s ifb  tM(u-rI'T)  I 


dz 


u=0 
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This  equation,  known  as  the  Cramer-Geary  inversion  formula, 
corresponds  to  equation  (2.7)  of  Daniels’  paper  and  is  the  form  used 
in  the  work  to  follow. 

The  main  problem  of  the  paper  is  to  evaluate  approximately 
integrals  of  the  above  type  when  the  statistics  c  and  c^  are 
calculated  from  moderately  large  samples.  The  cases  considered  are 
found  to  have  integrands  which  can  be  written  in  the  form 

cp(z)  [f(  z)]n 

where  n  is  the  sample  size. 

In  the  applications  considered,  cp(z)  may  be  expanded  about 
z  =  z  ,  where 

^’(z)  =  0  , 

and  the  resulting  series  integrated  term  by  term.  It  is  found  that 
this  leads  to  an  asymptotic  expansion  in  powers  of  (n  the 
dominant  term  of  which  is  used  as  the  approximation. 


5.  Non-circular  Markov  Process:  Known  Mean 

As  noted  by  Daniels  [(2  ),  page  175]j>  ”In  testing  for 
independence  the  use  of  a  circularly  defined  sample  serial  correlation 
coefficient  may  be  objectionable  on  grounds  of  loss  of  power  and 
sensitivity  to  extraneous  trends.  But  when  P  /  0  the  circular 


:  ...  '  -  ...  .  -;f  .  u  ■ 


■■■.-  >'t  . ...  Jx  -u:  -  q.t- Cj'  ,  a  i  v...  ,/.  •  .  t,'x 

■  "■  i ;  '  :;a  ).  ■  ' ::  ■  oo-  -.j.  ■  .  :;iVj; 


isno  3?.i  a  I  „  aal  t  si  .  ;  •  <  v  «  -ja  ;  j 

■  .  .  :  xU::.  ••  ;•  ‘  J  o; t  r, > ; o r 


'[  ,  ;  j  .  , 

.  . 

■  '•  '  :  ■  "■  j;  1<  ■ ' :i  .  T 


,  .  ’'V 


.  ::  ■  ! 

.  ’)  \  •  .  ::  .  '•  •  J  ;i  r c  J  ■- . ; 


»  .  ■  - 

-  -i!l  ['  J!  ,  .  J  ',j>  v c!'  ; 

•  •-  ©Iq«I63  ...  ;T 

•  '  '  '  :  ;  •  ■  '■  ,  '  ■  r!  .  -  •  j;:  ...  ..  . .  , 

... 


-  16  - 


definition  of  the  process  itself  is  artificial  and  can  only  be 
justified  if  the  results  arrived  at  by  its  use  are  not  substantially 
affected  by  the  assumption  of  circularity."  Hence,  we  shall  direct 
our  attention  to  the  sample  serial  correlation  coefficient  with  no 
circularity  assumptions. 

Consider  the  linear  Markov  process 

x  =  p  x  +  e  ,  s  =  1,  2,  ...,  n  , 

S  S~  1  s 

where  e^,  . ..,  e^  are  independent,  N(o, l)  random  variables.  It 
has  been  shown  that  the  process  may  be  considered  stationary  if 
| p |  <  1  ,  where  p  is  the  serial  correlation  coefficient.  Assuming 
this  to  be  true  we  have 


Cov(x  ,  x  ) 

'  s'  S-T7 


Let  Xp  . ..,  x^  be  a  sample  of  observations  from  the 
stationary  process.  They  have  a  joint  multivariate  normal  distribution 
since  e^,  ...,  e^  are  independent,  N(o,l)  random  variables.  The 
variance-covariance  matrix  of  x^,  0 . . ,  x^  is  the  (n  x  n)  matrix 


C  = 


1-p2  1-p2 


1-p2  1-p2 


n-1 


l-ff 


n-2 


l-p‘ 


n-1  n-2  1 

P _  P _  ...  — 


1-p2 


1-p 


- 

. -  :  ■  •  o  J'  ■  :  ,  .  .  '  :  .. 

-  j.  .  '  .  .1  x "  •  J.  .  ..  i.  ; 

i  .1  ..  (.  j.’.  .  .•  ...... 

„  i  x:  ..  1  ’i  j.  ■  1 

OOXC  >7  0 yJx.',  V  :  J.'j.  o'jii  j.  C.[) 


:  -  .  --t  :  .....  .  <:  •  I', I 

.  o  •  \  i.di:  :v/o  .  ,m  i  j 

.  t  .1  a  |  | 

.  >;  v  .  ....  j 


...  .  .  j:  :  .....  .■  .. 

. ; 

\  -.  ...  i  ■  ,  (  t 


:■  •  ■ . . 


.  ■:  ..  :  . 

,  „  . 


93j  III 


-  17  - 


To  obtain  the  value  of  the  determinant  |c|  and  the  inverse 


-1 


Of  £  >  £  f  We  Procee<i  as  followsl 


|c|  = 


first;  we  obtain 


l£l 
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n-1 
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column  by 

P 

and  subtracting 
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n- 1 

is  found  to  be 
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Proceeding  in  the  same  manner,  the  value  of  |c| 


(2.3.1)  |c|  = 


l-p‘ 

p 


l-p‘ 

1 


1-p2  l-p£ 


l-pc 


Now, 


-”1  = 


adj  C  . 

. 1 . jy 

1 9.1 


Adj.Ck. 

is  obtained  in  the  same  manner 

that  we  obtained 

C  is  symmetric. 

o 

t_i. 

n 

o 

(j  /  k) 

• 

Thus,  we 

find  C"1 

to  be 

the  (n 

x  n) 

matrix 
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The  joint  distribution  of  x^,  . . . ,  x^  is  given  by 
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d  F(x  .,0..,x  )  =  — — K-  exp(-2  x*  c"1  x]  dx  . 

1  "  ~  l£l2  -  -  -  1 

(2ir)2 


dx  , 
n 


where  C  is  the  variance-covariance  matrix  and 

x*  =  (*J_,  xn)  . 

For  the  case  under  consideration,  where  |c|  and  C  ^  are  given  by 
equations  and  (2.3.2)  respectively,  we  have 


j, 

d  F(x1,...,xn)  =  exp { -z  [x2  +  (l+p2)(x|  +  ...  +  x2^) 


(2 

+  x2  -  2p(Xl  x2  +  ...  +  x^1  x^]}  dx1  . 


dx 


n 


where 


The  sample  estimate  of  p  is  taken  to  be 


r  = 


'0 


X.  Xn  +  .  *  .  +  X  i  X  j 

12  n-1  n 


C0 


2.  P  2  2  1-2 

2  XT  +  X^  +  . . .  +  X  ..  +2  X 

1  2  n~l  n 


The  joint  moment  generating  function  of  c  and  c,.,  is 


M(Tq,I) 
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'  '  .  :  ■  : 


r 
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Tc  +  Tc  -  2  x'  C" 1  x 
u  u  —  —  — 


-  £[(1-T0)x®  +  (l+p;j-2TQ)(x|  +  ...  +  x2^) 


+  (l-T  )x2-2(p+T)(x  x  +  +  x  x  )] 

O  n  12  n-1  n 


=  -  2  x*  B  x  , 


where  B  is  the  (n  x  n)  matrix 


(2.5.4)  B  = 


1-T0  -(p+T) 

-(p+T)  l+p2-2T 

-(p+T) 


(0) 


0 


-(p+T) 

l+p2-2T 


0 


-(p+T) 


(0) 


Q  * 


l+p2-2T 


0 


•(p+T) 


■  (p+T)  l-T 


0 


Then  M(T^,T)  may  be  written  as 


1  00 


M(T0,T)  = 


(1-P2)2 


(2h) 


n  / 

2  -oo 


00 

r  -  i  x1  b  x  , 

.  .  /  e  - - dxx  ...  dxn 

-CO 


There  is  an  orthogonal  transformation  that  will  diagonalize  B  . 
Making  this  transformation  and  integration  we  get 


(2.3.5)  m(tq,t) 


i 
2\2 


(i-Pa) 


where  jB|  2  is  the  Jacobian  of  the  transformation, 


►  .  + 


.-.'1  — .  ' 


+ 


I 


,  ■  -  '  ;  i:;  -:j:  L  a -.is  I 


.  -  ~  i 


1  -I 


:  - 


-  J-T  ” 


■—  , 


- 


T  ' 


j'V  r  ;rj,  I  ,i  ;1  ;  \  ■■■ 


=  .  .  , 

v  ...  I 

-  Lil 


—  I 

;  j  Om  1  o. 
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III  is  evaluated  as  follows:  Letting 


1-T0  =  a 

1  +  ps  -  2T/a  =  b 


0 

-(p  +  T) 


=  c 


we  have 


111  = 


(0) 


(0) 


n 


b+(a-b) 


(0) 


(0) 


b  c 

c  b  c 

c  b 


(0) 


(0) 


b  c 


b  c 
c  b  c 


+(a-b ) 


•  * 


(0) 


n 


n 

(0) 

b  c 

c  a  n-1  . 


'  j w  ;  i  ...  .  j  :  J 


~  1 

- 

—  -- 


m  r  ^ 
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Similarly,  by  replacing  a  by  b+(a-b)  in  the  lower  right  hand 
corner,  we  obtain 

| B |  =  G  +2(a-b)  G  .  +  (a-b)2  G  .  , 

1  n  '  n-1  '  n-2 

where 


n 


b  c 
c  b 
c 

(0) 


c 

b  c 

•  * 


(0) 


•  • 


b  c 

c  b 


n 


Since 


a-b  =  -(P2-T0)  , 

the  value  of  ]b|  is  given  by 


(2.3.6)  |b|  =  Gn  -  2(p2  -  T0)  Gn_1  +  (p2  -  T0)2  Gn_, 


It  can  be  seen  that 


n 


b  c 

- 

c  (0) 

c  b  c  (o) 

c  b  c 

b  ' 

•  »  * 

-  c 

*90 

(o)  ... 

( 0 )  ... 

b  c 

b  c 

c  b 

n-1 

c  b 

n-1 


=  b  G  -  c2  G  _  . 


n-1 


n-2 


?.  :  I  -X 


i  •  .  ■  \r:  ■- 


*s) 


~T 


jfi' 


I 


| 

: 


l 

I 

i 


O 


'  .. 


•i  J ' 


l:“ 


: 


■  /  +  r'°  \  ■ 


: ,  - 


v  J 


.... 


- 

a 


3 


a 
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That  is, 


(2.3.7) 


Gn+2  “  b 


G  .  +  c2  G 
n+1  n 


0 


Letting  E  be  the  forward  difference  operator  of  the  calculus  of 
finite  differences  defined  by 


(2.3.8)  E  [f ( j )  ]  =  f(j+l)  , 

equation  (2.3. 7  )  may  be  written  as 

(2.3.9)  (E2  -  b  E  +  c2)  Gn  =  0  . 

The  auxiliary  equation  of  equation  (2.3.9  )  > 
x2  -  bx  +  c2  =  0  , 

has  the  roots 

b  +  si b2  -  4c2 
u  =  - g - 

and 

b  -  s!b2  -  4c2 


where 


and 


u  +  v  =  b 


u  v  =  c2 


Hence,  the  general  solution  of  (2.3.9  )  is 


_  .  n  .  n 

Gn  =  A1  u  +  *2  V  • 


:  f  -  -  . 

.  -r  -h 

I  3  :  10:  ... 

■  f/J: f.-1  v)  J  i  H.C  7 

t  +  .  .  .. 

.>.■ 

c'  ■'••■  +  -  '•  :  .  .  .• 

t.  ..  :  >  'j; 

--  '  -h 

■  3 ,  ■ a.r,r.. 

: -  :  -J- 

■:  jog 

-  - 

O'.fO  IvT 

i  --  '  4*  u 

■  /JS 

.  .J  =  v  i 
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It  is  now  necessary  to  evaluate  and  A^. 


Evaluating  for 


n  =  0  and  n  =  1  we  have 


and 


0 


Gi  -  b 


respectively,  so  that 


0 


A1  +  A2  =  1 


and 


G^  =  u  +  Ao  v  =  b 


From  this  it  is  found  that 


A, 


u 

u-v 


and 


-v 


u-v 


and  hence,  the  solution  of  equation  (2.3,9  )  is 


(2.3.10)  G 


n 


n+1  n+1 

u -  v 

u-v 


Let 


1 

z  +  — 

z 


=  1  +  -  2  T 


0 


p  +  T 


-  -  <t> 


so  that 


-  -  -  "  . 


•  '  +  -  / 

"  o'.  -Jx  •  o::  ■ 

- 

~ 

. —  ~  , .... 

- 

.  »  .  loxifii  oirUti.  ; 


- 

- 


. 


3y,  I. 


T  S 


'  +  - 


•  + 


.  /•  j  oa 
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(2.5. 11)  z2  +  £  z  +  1 


0  . 


The  roots  of  equation 


(2.3.11)  are 


z 


-  b  +  \l b2  -  4c2 
2c 


v 

c 


and 


1  -  b  -  s/b2  -  4c2  -  u 

z  ~  2c  c 


Hence, 


and 


v  =  -  c  z 


> 


u-v 


Substituting  these  values  of  u  and  v  in  equation  (2.3.  K)),  the 

value  of  G  in  terms  of  z  is 
n 


(2.3.12)  Gn 


(-c)n 

Zn(l-z2) 


U 


2n+2-i 

z  J 


By  equations  (2.3.  6)  and  (2.3.12)  and  replacing  a,  b  and  c 
their  values,  we  have 


(P+T)n 

zn(l-z2) 


r .  2n+2 

[1-z  ] 


2(p2-T0)(p+T)n"1 

zI1“1(l-z2) 


] 


(p2-T0)2(p+T)n'2 

zn"2(l-z2) 


[1  - 


2n-2, 
z  ] 


by 


■  -  ■  i  ■  ■■.  I  ■ 


* 

. '  ' 


- 


- 


'  '  J>  1:  j. 


•  ,+/4 


i  o  t 


:r  .•  wo 


“  L 


-1' 


- . 
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On  collecting  terms  this  reduces  to 


(2.3.15)  |b| 


4^ui 

2n(l-Z2) 


z(p2-T  ) 
_ 0  -j2 

P+T  J 


2n  r  (p2-T  l21 

z  Lz  -  _ 0  J  J  . 

p+T 


As  mentioned  in  Daniels'  paper,  it  can  be  shown  that,  if 

2n 

(l-r2)  is  not  small,  leaving  out  the  term  in  z  within  the 

bracket  in  equation  (2.3.1?)  incurs  an  exponentially  small  error  in 

2n 

the  final  approximation.  Omitting  the  term  in  z  ,  the  approximate 
value  of  |B|  is 


/rJ.T^n  z(p£-T  ) 

(2.3.14)  |b|  -  [1  _  ]2 


zn(l-z2) 


p+T 


Now,  let 


(2.3.15)  u  =  Tc  +  r  T 


so  that 


1  _  1+p  ~2To 

Z  +  z  p+T 


1+p  ~2u+2rT 
p+T 


or 


(2.3.16)  z  +  1  ,  1 . +  i>a--;...2.P.r— +  2r 


p+T 


Hence, 


1  -  2rz  +  zc 


1  -  2pr  +  p2  -  2u 

p+T 


and 


..  ■  ....  .J  <2<  y  ;i  :  (J.:;  ■'-•i.u  >  h<- 


*.  L 


J 


j: 


:  :  1  ...  (  .  :  .»(  ■ 

1  ■  .  -\:~i  . 

;  .  .  .  . 

;  .  ..  .  .:  IbuI 

ai  |  i  j  :  • :  J! 


+ 


, 


+  I 


-  '  +  ' 
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(2.3.17)  P+T  »  ^(1  -  g.Pr  +  ?  -  2.)  _ 

1  -  2rz  +  z2 

From  equation  (2.3.17)  we  see  that  T  may  be  written  as 

(2.3.18)  T  =  -  ((l--»)(<-:0  +-2u?]  . 

l-2rz  +  z2 

By  use  of  equations  (2.3.15)3  (2.3.17)  and  (2.3.18)3 
it  is  seen  that 


1  z(p  “1q)  ^  ( l-2rz+z2)(p2-u+rT ) 

1  ~  - ^ —  =  1  - 

p+i  l-2pr+p2-2u 


or 


(2. 3. 19)  1  -  1-— .5^ 

P+T 


( l-2pr+p2-2u )  -  ( p2-u  )  ( l~2r  z+z2  )+r  [  ( 1-  pz )  ( p~  z  )+2uz  ] 

l-2pr+p2-2u 


(l-pz) [l~pr-(r-p)z]-u(l-z2) 

l-2pr+p2-2u 


Using  equations  (2.3.17)  and  (2.3.19)  in  equation  (2.3.14), 
the  approximate  value  of  |b|  is  found  to  be 


|BJ  zn(l-2pr+p2-2u)n  ^  ( 1-pz)  [l-pr-(r-p)z]-u(  1-z2)  j2 
zn( l-z2)( l-2rz+z2)n  l-2pr+p2-2u 

=  ~'2u^ - -  {(l-pz)[l-pr-(r-p)z]-u(l-z2JJ2 

(l~z2)( l-2rz+z2) 


Substituting  this  result  in  equation  (2.3.5)  gives 


+ 


1  G"3i 


:'i'0  \  i 


-\-s 


-  T-  -- 


..  ;'1~  1 


•  :>  .a.«: 


i 


.  i  ...»  j.  k 


or  •  ;  .  ; 


:  xxoi.qc  : 


■  '  1  31 
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!  1 

2N2/1  „2\2 


,2  \2 


(2.3.20)  M(u-rT,T) - 


( l-2pr+p2-2u)‘~  1  (  1-pz) [l-pr-(r-p)z]-u(  1-z2)} 

1  +  P2  -  2T0 


with 


z  + 


P+T 


Although  some  errors  were  present  in  equation  (6.4)  of  Daniels' 
paper,  equation  (2.3.20)  above  and  equation  (6.5)  of  Daniels' 
paper  are  the  same. 

Since  equation  (2.3.17)  holds,  we  have 

(2.3.21)  —  =  ( l-z2)( l-2pr+p2-2u) 

6z  (l-2rz+z2)2 

Combining  equations  (2.3.20)  and  (2.3.21),  we  obtain 


M(u-rT,T)  —  ^ 

6z 


( l-z2)£'(  1-p2)  (l-^rz+z2)* 


n 


(l-2pr+p2-2u)^  ( ( 1-pz) [ l-pr-(r-p)z]-u( 1-z2) } 


and  hence, 

6 


6t 


6u 


[M(u-rT,T )  — ] 

6z 


(l-z2)g(l-p2)2(l-2rz+z2)fc 


( l-2pr+p2-2u)  { (l-pz) [ l-pr-(r-p)z]-u( 1-z2) } 


x  [n-4  +  - (l-zg)(l-2pr+pf-gu)  j 

{( 1-pz )[l-pr-(r-p)i-u( 1-z2)} 


so  that 

6_ 

6u 


5 


[M(u-rT,T)  — ] 

6z 


n  ( 1-  z2  f  ( 1-  p2  f  ( l-2r  z+z2  f 


n 


u=0 


( l-2pr+p2 )  ~  { ( 1-pz ) [ 1-pr- ( r- p ) z ] } 


{  1  +  1  [  (l-z2)(l-2pr+pg)  _  . 

( 1-pz ) [ l-pr-(r-p)z] 


x 


'-1 


-1  '  ■  :  :  1  1  ■ 


,o>:; 


:  ... 


jCI 


..  snoi: 


-■  .  -[  .  -  -  -■  . 


L  -  '  •  :  ] 


]  — 


f 


J 
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By  equation  (2.2.2),  we  have 

n(l-P2r 


1 

v2 


(2.3.22)  h(r )  ^ 


where 


2rti( l-2pr+p2) 


B_  i 
2 


cp(z)  (l-2rz+z2)  dz  , 


(2.3.23)  cp( z )  =  j- - / - ri  {l  +  -  _  4]} 

^  i  \  /  (l-pz)[l-pr-(r-p)zj  n  ( 1-pz)  {.  l-pr-(r-p)z] 


With  u  = 


1 

z  +  —  = 

z 


0,  the  mapping 

1  +  p2  +  2rT 

P+T 


is  easily  seen  to  consist  of  the  following  elementary  mappings: 


A  :  V  =  p  +  T 


B  :  U 

C  :  S 


V 

l-2pr+p2 

1 

2U 


D  :  Q  =  S  +  r 


E  : 


z  +  -  =  2Q 

z 


A  maps  the  T-plane  cut  along  the  parts  of  the  real  axis  exterior  to  the 

(1;P)2 

2( 1-r ) 


}  onto  the  V-plane  cut  along  the  parts 


interval  { 


~(l+p)‘ 

2 ( 1+r ) 


of  the  real  axis  exterior  to  the  interval 


r  -(l-2pr+p2) 
1  2 ( 1+r ) 


(l-2pr+p2) i 
"2  (1-r)-  J 


B  maps  the  region  of  the  V-plane,  as  above, 
along  the  real  axis  exterior  to  the  interval 


onto  the  U-plane  cut 

f  -1  1  ] 

2(  1+r )  ;  2( 1-r )  ° 


■  I  l 


4-  1 


=  / 


; .  -  ■: 


+ 


..  ' 


1  - .  : 


- 


J  j-  ■  ~  .  . 

.  ,  . .  i;. 


.  ::  ;  ;•  1 


.  c  -  :  ..  *i 

\  -j-  •  .  -  'J  '.it  I:.’  -I.j;;  O.1. 
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C  maps  this  region  of  the  U-plane  onto  the  S-  plane  cut  along  the 
real  axis  from  -(l+r)  to  (l-r).  This  region  of  the  S-plan.e  is 
mapped  onto  the  Q-plane  cut  along  the  real  axis  from  -1  to  1  by 
D,  and  this  region  of  the  Q-plane  is  mapped  onto  the  interior  of  the 
unit  circle,  |z|  =  1  ,  in  the  z-plane  by  E.  Hence,  the  net  effect 
of  the  transformation  is  to  map  the  whole  T-plane  cut  along  the  real 

axis  exterior  to  the  interval  {  g (l+r ) .  ’  ^ ^(~l  r ) ^  onto  the  interior 

of  the  unit  circle. 


To  obtain  the  end-points  of  the  path  of  integration  in  the 


z-plane,  we  note  that  as  T  goes  to  +  i 
since,  by  equation  (2.3.16), 


,  z  +  —  goes  to  2r 


If 


1 

z  +  — 

z 


u  =  0 


1  +  p2  -  2pr 

P+T 


+  2r 


z  + 


=  2r 


then 


z2  -  2rz  +1=0 


and 

z  =  r  +  i\/l-r2 


or 


z 


+  id 


where 


J :  =v 

o.:: 

a. 


:  -  - 

-  -  j  .  ,-r.  ,  -  .... 


t.  J  ■  J  -  r,; 

1  -  J.  =  j  j,  . 

. 

.  .  .  .  ;  : 


+ 

■K.  , 


.  ■  .:.  :  v:  .  o;‘  -  -c.  J;  :  .m 


■  •  JL 


'  .  'it  u'i . 

:  +  1  +  >  :i  .  '■  ;  -  :  j  - 


i'. 


_ 


i 

~r 


- 


Jr 


J: 


■ 


We  also  see  that  if  T  =  0 


z  + 


1 

Z 


P  + 


JL 

P 


and  hence,  the  transformed  path  in  the  z-plane  cuts  the  real  axis  at 

z  =  p.  Thus,  the  path  of  integration  in  the  z-plane  crosses  the 

real  axis  at  z  =  p  and  ends  on  the  boundary  of  the  unit  circle  at 
-i@  IQ 

e  and  e  ,  where  r  =  cos  0, 


The  only  possible  singularity  in  the  integrand  of  the  integral 
for  h(r)  would  be  the  real  singularity  arising  from 

1  -  pr  -  (r-p)z  =  0  . 


This  singularity  is  avoided  if,  on  the  real  axis,  we  confine  z  to 
the  following  ranget 

(i)  P<z<r,  p  <  r 

Now,  we  may  write 

l-pr-(r-p)z  =  (l-z)(r-p)  +  (l-r)(l+p)  . 

Then,  since 

j  p  |  <1  and  j  r  |  <  1  , 

we  see  that 


1-z  >  0,  r-p  >  0,  1-r  >  0  and  1+p  >  0 


From  this  it  can  be  seen  that 


'..i  :i  '"03  o  ;ov; 


:  o  i'J  '-.o'.- 


-•  '  -o' 


:  ..  '  ah, 

. '  .  :  .  is  1  t  ' 


1  o  -  :  . .  ■  . 

.  .. 


"r  "  ':  '  ■.  >  -  >  o,  .  j 

1  \  o  ■' 


+  V 


•i'll  -  ,  I 


; 


O'  o ' 

r  i 

-i.  :  jl 
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(l-z)(r-p)  >  0  and  (l 
and  finally,  that 

1  -  pr  -  (r-p)z  >  0  . 

(ii)  r  <  z  <  p  ,  r 

Here, 

l-pr-(r-p)z  =  (l-r2) 


As 

| p |  <1  and  | r  J  <1  , 

we  have 

l-r2  >  0,  p-r  >  0  and 

Then 


( p-r ) ( z-r )  >  0 


and  hence 


1  -  pr  -  (r-p)z  >  0  . 

(iii)  z  =  r  =  p 


Since 

| p |  <1  and  j  r  j  <1 
1  -  pr  >  0  and  (r-p)z 


r ) ( 1+p)  >  0  , 


<  P 


(p-r) (z-r)  . 


z-r  >  0  , 


•  .  +-'• -  , 


■  Ilf  "■ 


■  '  -  - 


-  ;  +  '  •>.  --  - 


eA 


_ 


~  J 


=  = 


i  .  :  j.  ..c ; 


J.  >  | 


= 


I 
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so  that 

1  -  pr  -  (r-p)z  >  0  . 

Since  there  is  no  singularity  in  the  closed  interval  joining  p  and 
r  ,  we  may  deform  the  path  of  integration  in  the  z-plane  to  be  the 
straight  line  joining  e  L  to  e  and  crossing  the  real  axis  at 
z  =  r. 

On  the  path  of  integration  we  may  write 

i_ 

(2.3.24)  z  =  r  +  i  w(l-r2)2  , 

where  w  is  the  real  variable  with 

-  1  <  w  <  1 


Then 


1  -  2rz  +  z2  ~  (l-r2)(l-w2) 


and 


1 

dz  =  i(l-r2)2  dw 


Substituting  equation  (2.3.24)  in  equation  (2.3.22),  we  have 


1  n-3  , 

}  £_2 
/  cp(  2 )  ( 1-w2  )£"  dw  . 

—  _  1  J 

2jt  (  l-2pr+p2)c 


(2.3.25)  h(r)  ^  hL^)-2 ! 


The  integrand  of  h(r)  is  of  the  form 


n 


cp(z)  [f(z )]‘ 


-2 


where 


. 


-  .  .  . 


- 


"> :  > 


•  ■  '  ’  ,:i 


•i  •  oi  • 


:  ...  <  f 


.j.  - 


_ 


.  ■  . 


. . 1  .... 


.  :  to 


. 


- 


-  Jk  - 


iJ/( z)  =  1  -  2rz  +z2 

Since  the  integral  cannot  be  readily  evaluated  in  closed  form,  we 
expand  Cp(z)  as  a  power  series  in  (z-r)  ,  where 

^’(r)  =  0  , 

and  integrate  with  respect  to  w.  Using  equation  (2.3.24)  ,  we  have 
z  -  r  =  i  w(l-r2)^ 


and  hence, 


cp(z)  =  cp(r )  +  cp'(r)  (z-r)  +  ...  +  ^ . ^~r.L 


+  ... 


1  .k  k  /  2\ii  /,  \ 

=  cp(r)  +  ixvf(  l-r2)^1©’  (r )  +  ...  +  — — -  ^  r  -  qr  (r)  + 


k 

n2 


Substituting  this  in  equation  (2.3.25)  ^  we  have 


—  oo  lr  —  i  n 

^  m  ,/  ^  n(l-p2)2(l-r2)  2  V  i"(l-r2)£  (k),  ^  k/n  2n2~2 

(2.3.2o)  h(r)  ~  — - — — J <P  U)  w  (1-w  ) 


k 

\2 


dw 


2it(l-2pr+p2)': 


k=0 


j 

-1 


Now,  if 


k  =  2m+l  ,  m  =  0,  1,  2,  ...  , 


wk(l-w2) 


then 


.  ( 


% 

.1:, 
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is  an  odd  function  and  the  integral  vanishes.  Therefore,  equation 
(2.3.26)  reduces  to 


(2.3.27)  h(r )  -v  n-(.1.-p2).  .(.^.11 - 


2it  ( l-2pr+p2) 


H  -  1 
2 


CO  i 

\  (-l)k(l-r2)k  (2k) /  ,  r 2k,,  2N 

L  . (2k):  '  *  (r)jw  (1“w  } 

k=0  -1 


aw 


To  evaluate 
1 


n 


(2.3.28)  Ik  =  j  w2k  (1-w 2)c 


dw 


-1 


we  proceed  in  the  following  manner!  Letting 


2  1  -2  ■, 

w  =  u  ,  dw  =  —  u  du  , 


we  have 


Ik  = 


n 

,  J.  —-2 

k-2  /  \2  , 

u  11-uJ  du 


P(k  +  \  ,  |  -  1) 


0 


=  r(k  +  |)  r(|  -  1) 
r(k  +  |-i) 


Thus,  we  have 

for  k  =  0  , 


r(|)  r(§-i)  -f«  r(|  -  1) 


r(2fi) 


k  =  1  ,  I  = 


r(|)  r(|  -  1) 
r(2|i) 


n-l  I0 


k  =  2  ,  I„  = 


r(§)  r(|  -  1) 
rC2*2) 


1.5  T 

(n-l ) (n+1 )  0  ’ 


and  in  general,  for  k  =  1,  2,  ... 


ro|3 


I  ■'  - r  \ 


a. : 


so: 


_n  i 

X- 


/ 


-  -  j  ' 


ji-  y 


: 


(2-5*29)  \  "  (n-l)i^i)'..(:k(nk-5)  *0  ’ 


where 


0 


•T*  r(|  -  1) 
r(2§i) 


we  obtain 


Substituting  equation  (2.3.29)  in  equation  (2.3.27k 


n~5 


h(r) 


or 


n(l-p2)2(l-r2)  2  I 


2it(l-2pr+p2)‘ 


0  frnf  i  )  .  (_1)  (l"r2)  -D(2k)M  [1.3...(2k-l)] 

~r"  Ml)  +  l  9  (r)[Crfyr.T(^2k-3)]' 

2  k=l 


£l2 


(2.3.30)  h(r)  ~ 


n  r(2  X)  (l-pa)2(l-r5)  2  [  ,  '  V  (-l)k(l-ira)k  (p(2k)(r)j 


a/«  r(^) 


( l-2pr+p2  / 


S  -  1 


4“]_  2kkJ  [(n-l). . .  (n+2k-3)] 


since 


(2k).‘  =  2k  kj  [ (2k- 1)  ...  3.1]  . 


By  replacing  z  by  r  in  equation  (2.3.23)  ,  we  have 


cp(r)  = 


(j-r 2r  fl  .  I  r l-2pr+p^ 
( 1-pr)  n  1-pr 


-  4]} 


( l-r2)2  r,  ,  -lx1 

=  (liM  u  +  u(n  )} 


Then  a  first  approximation  to  h(r)  is 


.;:j : 


•  /  J 


r 


r_. 


1 

•  • 


•  •  )  0;^..  .,3  ,, 


•f  ~  . 


+  j 


v  ~  ; 


+ 


'  ■  ;  --  '  -  . , 
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(2.3.31)  h(r)  ~ 


r(S-l)  2\2/.  2 \2 

n  2  C 1— P  )  ( 1-r  ) 


5-i 


a/*  r(S^i) 


n 


(l  +  OCn'1)} 


(l-pr)(l-2pr+p2)‘ 


-1 


This  corresponds  to  equation  (6.7)  of  Daniels’  paper. 


4.  Accuracy  of  the  Approximation  and  Renormalization  of  h(r) 

In  the  expression  for  h(r)  ,  given  by  equation  (2.3.31); 
the  remainder  is  relatively  0(n  ^)  though  an  exponentially  small 
term  has  also  been  neglected.  We  assume  n  to  be  large  enough  for 
this  term  to  be  negligible.  Some  insight  into  the  errors  involved 
is  obtained  by  a  heuristic  discussion  of  orders  of  magnitude. 

In  what  follows  we  show  that  the  variance  of  r  is  0(n  \) 
and  values  of  h(r)  outside  some  range  on  either  side  of  p  ,  which 

i_ 

is  0(n  2 )  ,  are  negligibly  small.  Then,  over  the  effective  range 

_i 

of  r,  (r-p)  can  be  taken  as  0(n  2 ), 

From  equation  (2.3.31)  we  see  that 

n  r(§  -  !)  1  1 

h(p)~—  —fj - y-  - — r  {l  +  0(n-1))  . 

aA  r(2-§-h  (1-P®JF 

Now,  by  Stirling’s  formula, 

r(x)  =  e"X  xX  '  1  (2 {1  +  0(x”1)}  , 


r(f-i) 

r(^) 


=  e 


sfr) 


n-1 

~ 


,  1 
{  n-1 ' 


V  2  ) 


u 


0(n’1)) 


we  have 


....  ...  ■  I-.  .  .  ■  ;  • »  , 


...  - — -  —  ■  -  ■  •  ’  ■  -  ■  -  ■ ,'i 1 .  •  v ;  ■ ; 

......  ; 

...  XI  .  ■  '  .  '  ij 

- 

-  •'  ;  •  ...  ; 


I  :-J  .  1 .  .  ■  ");X 

'  *  •  .  i  ■  ..  s 


.  -  •  ....  .  ...  ..... 


ai 


1  :i'.j 


\  „  . 


'  -  )  ■'  +  -t  j 


r 


~  y.i 


JC 


t. 


fV.  , 
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As  n  increases, 


a  -  -  i  , 


n-1 
1  \  2 


'v.  e 


i 

-2 


and 


_  1.  _  i 

/  n-2  •> -a  /  \2 

(-g-)  -  (-) 


h(p)  -V  [  - 2 - _  f  {X  +  op'1)} 

2it  (l-P2) 


Hence,  h(r)  is  0(n“  )  at  r  =  p. 


To  establish  a  bound  on  the  order  of  magnitude  of 
^“.[(r-p)2]  ,  consider 


(l-r2)‘ 


£  i 

2  ~-i 


n 


( 1-pr )  ( l-2pr+p2)‘ 


1  r  1-r  ,2 

"( 1-pr]'  i_2pr+p2 


1  ri  (r-p)a  .2-1 
(1'pr)  l-2pr+pa 


< 


n 


[1  -(-^=£-)2]2 


-1 


(i-|p!)  i+| p| 


Also,  as  shown  above, 

uu  r(g  -  x) 

sfn  r(2§i) 

a. 

is  0(n2 ). 


'•XT 


"\~S )  JC. 


'c  -1  {  '  •■■  )  .  ,/ :  i 


'  <  Cl  c  :  , 


.-j;  ,i  ■ 


[ 


'  : 


Ai 


uv/Xsrt -i  ",  .  ■' 
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Let 


g(r) 


r)=_n_  r(2  ~  (l-pa)2  (l-ra) 


--1 

2 


r  C^TT1) 


(l-pr)(l-2pr+p2)‘ 


so  that 


-1. 


h(r )  ^  g(r )  [1  +  0(n"  )]  . 


Then  it  follows  from  the  foregoing  discussion  that 


g(r )  <  0(n2)  [1  -  )2]2 

l+l  P 1 


and 


0  <  <E  [(r-p)2]  =  J  (r-p)2  h(r )  dr 

-1 

1 

n 

~ J  (r-p)2  g(r )  dr 

-1 

1 

<  0(n^ ) J  (r-p)2  [1 

-1 


i+l  p! 


ar 


Let 


r-P 

1+1  P I 


=  u 


r 

/ 

J 

-i 


i-p 

i  i+ 1  pi 


(r-p)2g(r )dr  <  0(n2) 


£-1 

u2  (l-u2)^  du 


-( 1+p) 

1+  l  pi 


then 


efcvj 


)  i\ 


.  [(  +  13 


'  '*•  I 


-  '  '■->  '  cl;} 


;  .,a  r 


-  J  i  -  /'  1 


<r 


J 


_ 
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— -1 
v2 


<  0(n  )  1  u2  (l-u2)  du 
0 


a  r(|)  r(|) 

=  0(n2 )  2  2 


r(^) 


OCn'1)  . 


This  suggests  that  the  distribution  of  r  is  concentrated  about  r  =  p 

x. 

within  a  range  which  is  0(n  2  )  on  either  side  of  p  . 


From  the  above  discussion,  we  have 


(1-r  2Y 


(l-pr)(l-2pr+p2) 


2 


(ItIpI) 


exp  {(§-1)  log[l  - 


(_I=P_)2]) 
1+1  P  | 


It  is  known  that  if  |x)  <  1 


log(l-x)  =  -  x  -  ^  x2  -  ~  x- 


Then,  since 


(^)s  <  i , 

i+|p| 


exp{(§  -  l)log[l  -  (^-)£J)  =  exp((§  -  1)[  -  (-^)2  - 


1+1  P  | 


i+l p|  i+Ip1 


<  exp  [-  (2-  -  i)(  r~P-)g] 

s  u|p| 


Hence, 


J .  id  .  ;  ■; 


3  a 


;  r  x 


:  J;  ■/ 


I 


- 


I 


-J  < 


-  41 


2x2 


-1 


Iklfl 


( 1-pr )  ( l-2pr+p2 ) 
Thus,  we  have 


<  - i -  exp[-  (|  -  1)(  ±-=-£  )2]  . 

§-l  (l-|p|)  l+|p| 


g(r )  <  0(n“  )  exp[-  (§  -  i)(-.-r~p, 


l+|p| 


a 


Suppose  that  |r-p|  is  0(n  ).  Then 


(§  -  D(-^)2 


i+l  p  I 


is  and 


exp[  -  (§  -  l)(-^£-)2] 

2  l+|p| 

will  tend  to  zero  exponentially  as  n  -» °o  provided  CC  >  -  1.  Thus 
g(r)  ,  and  hence  h(r)  ,  is  exponentially  small  for  values  of  r 
outside  some  range  on  either  side  of  p  which  is  0(n  2 ).  We  conclude 
that  over  the  effective  range  of  r  ,  (r-p)  rosy  be  considered  0(n  2 ). 


We  now  show  that  if  r  is  replaced  by  p  in  the  first 
neglected  term  in  the  expansion  of  h(r)  the  term  is  altered  by  an 
amount  0(n  ).  Considering  equation  (2.3.30),  we  see  that 


h(r) 


where 


n  r  ^2  lj  (l-p2)2(l-r2)  ^ 


(l-2pr+p2)‘ 


-  1 


(  (l-r2)cp"(r)  ~2m 

q,(r)[1  '  a(a-i)pTr)  +  0("  )] 


tp(' 


r)  =  4=^  [1  +i  [  ilfpr+pf  _  4]) 

(1-pr)  n  1-pr 


1 1 1 1  -fi 

j  ■  ■  |  •!  ~  r  j  <  .• 


[ "  . -  : ;  '  ■  • 

hM 

^  -•  ’ '  '  J-  ^  j;;_  ■ , 

"  . -  ■■  .  y:<  , 

~  .  ” 

■'  X  j  : /o,  uC:  \  .  , 

-  .  '•  /  ...  c  o 

:  '  ...  - 
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We  may  write 


=  {l  +  -  [  1“  "  4]  +  0(n"2)} 

(1-pr;  n  1-pr  ' 


since 


(r-p)2  is  0(n  ^).  Then 


n-5 


(2.4.1)  h(r)  ~ 


n  r^2~1^  (l-r2)  2 


I  L 

2\2  (->  _2\~2 


a/*  r(^i)  §-i 

2  (l-2pr+pa)2 


(l~p2)2  (l-r2) 

ffcprj 


On  expanding 


i  A. 

,2\2  /n  2\2 


(1-p2)2  (l-r2) 

1-pr 


in  a  Taylor's  series  about  r  =  p  ,  we  find  that 


(l-p2)2  (l-r2)2 

1-pr 


■  +  0[(r  -  p)J]  , 

2(l-p2)2 


and  on  expanding 


l-r2 

l-2pr+p2 

in  a  Taylor's  series  about  the  same  point,  we  have 


_Jce1_  .  !  -  <£l£E  +  0[(r-p)3]  . 

l-2pr+p2  1-p2 


The  binomial  expansion  of 


I 

J  " ' 


•  s. 


'  -  J 


= 


~  +  -  - 
.  . 


J.C 


- 


-a 


"  -  • 
V  -1*  ~ 


\  ,  /  - 


. 


)c 


■  0  “• 


"  [;  “ 


•J-'i  .  , 

•_  J  a  r 


X 


[ 


£  + 


'•  •  .  '  ;  ;  .  .  ■  ■ 


.  C  --;J 


-  4?  - 


yields 


so  that 


,  r2  2U-PS) 

l-2pr+p2 


=  (1  -  +  0[(r-p)';]} 


2(l-p2) 


l-p£ 


i  r2  2(l-p2)  /  \2  x 

(— — - )  =  1  -  +  0[ (r-p)'  ] 

l-2pr+p2  2(l-p2)2 


(l-p2)2(l-r2)2 

1-pr 


2  2(l-p2) 

( - -)  +  0[  (r-p)"  ] 

l-2pr+p2 


and 


(2.4.2) 


1  1 

( 1-P2)2( l~r2)2 

1-pr 


=  (- 


2  2(l-p2)  -I 

1  ■)  [1  +  0(n  '•)] 


l-2pr+p‘ 


1 

since  (r-p)  is  0(n  2 ).  Substituting  the  result  (2.4.2)  in 
equation  (2.4.1)  ,  we  obtain 


where 


N-l 


h(r) 


n  r(f-D  (l_r2)  2 

s/i i  r(^)  | 

2  (l-2pr+Pa)2 


r  t  1  rl~r2  .  -| 

x  [  1  +  —  [- -  -  4]  - 

n  Ll-pr 


(l-r2)  cp"(r)  n,  2\  ■) 

g(n-l)  <p(r)  +  0(n  )  ]  ’ 


N  =  n-l  + 


l-p* 


q(r) 


l-r2 

1-pr 


-  4]  - 


( l-r2  )cp"(r ) 

2(n-l)cp(r) 


Let 


[ 


-  ■.] 


-  kk  - 


Expanding  q(r)  in  a  Taylor's  series  about  r  =  p  gives 
q(0  =  q(p)  +  q'(p)  (r-p)  +  ... 

Now, 


is  0 ( 1 )  and  q'(p)  is  0(n  ^).  Thus,  since  (r-p)  is  o(n  "  ), 

.  5 

q(r)  =  q(p)  +  o(n  2) 

_  *d 

=  q(p)  [1  +  o(n  t~)]  . 

But,  since  q(p)  is  independent  of  r  ,  it  becomes  part  of  the 
normalizing  constant.  Hence, 

N-l 

h(r)  ^  K  [l  +  0(n  2)3  , 

( l-2pr+p2)CL 

where  K  is  an  adjusted  normalizing  constant. 


Employing  the  above  results,  we  shall  now  proceed  to  re¬ 
normalize  h(r).  First,  consider 


and  let 


k-1 


( 1-r2) 


—  dr  , 


k  =  1,  2, 


_1  (l-2pr+p2)2 


u 


1  +  r 
2 


Then 


' 


1 


\  ;)(>  -  ...... 

.  [  +  -  j  X  '  .  .  - 

-•  '  v  ■  '  ■■  f.:0'  .  ,) . 

-  ..  .  :  ; 


I.  .  .  +  ->  ] 


:  :  ■  -X  ■:  . 

'v  ■ 1  ;  ■  1  .  .  v'  ,i 


‘  -1  « 


- 


1 


- 
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1  k-l 


k-l 


k  d+P)k 


2  /,  N  2  r,  4pu 

u  (1-uj  LI  - 


k 

2 


du 


(l+p); 


It  can  be  shown  by  [(15),  page  293*  example  no.  I]  that 


(2.4.3)  J 


2k  [  r(^i)  ]a 


k  (!+p)k  r(k+i) 


F[  §  ,  ;  k+1  ;  4p  )  , 

2  2  (1+p)2 


where  F[a,b*  c*  z]  is  the  usual  hypergeometric  function.  It  follows 
from  [(4),  page  64,  formula  24]  and  the  hypergeometric  power  series 
that 

f[  §,  k+i;  4p  ]  =  (i+p)k  f[  o;  |+i;  P£] 

(1+P)2 


=  (1+P)R  . 


Then  equation  (2.4.3)  becomes 

2k  (r(i±i)]a 

j  =  _ £ _ 

k  r(k+i) 

Using  the  duplication  formula  for  the  gamma  function,  [(l^),  page  240], 
we  have 


2k  [r(^i)]a 

k  2k  (k)^r(i|i)  r(|+i) 
r(|+i) 


Thus  we  have  shown  for  k  =  1,  2,  ... 

1  k-l 

(2.4.4)  Jk  =  J  . dr 

"1  (l-2pr+p2)  2 


A  r(ffi 
r(|+i) 


.  YrJ.  . 


-  :  £  J. 


.  U 


. 


.  T-i  J 


"[ 


j  1  ] 


.L 


-• 


•  .  :  :  T  ] 

[  ■'  ] 


l  :  -  : 


+ 


] 


[ 


-OOSG 


/  :>X'J  .  ■  :j  3  1 


■  [  -  +-  ;  '  ] 


", 


.  ■■  /  ’  I 

•  :  .:l  '  -i  •.  :c  c  J..  .  [:i  j;  ;l< 


.  .r 

L  . - ,  J 

V. 7  - 

■  v - /  J  °  V?c) 


-t-.  nv 


•  I  =?  .• 


+  : 
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Employing  this  general  result,  we  see  that 
,  N-l 


I  = 


( 1-r2) 


2 '  2 


V*  r(S^) 

r(|+i) 


N 

-1  /,  ~  .  PN  2 


dr  = 


( l-2pr+p2) 

Then  the  renormalized  density  function  is  given  by 

_N-i 

(l-ra) 


where 


and 


h(r )  ~  K(n,p) 


.2\  2 


-  2 


( l-2pr+p2) 


N 

2n  2 


[1  +  0(n  c)]  , 


K(n,p)  .  i  = 


r(|+i) 

r(^) 


N  =  n-l  + 


1-P‘ 


This  is  Leipnik' s  form  of  h(r)  and  corresponds  to  equation  (7.4) 
of  Daniels’  paper. 


5.  Non-circular  Markov  Process.  Unknown  Mean 

We  consider  briefly  the  case  in  which  the  mean  is  unknown 
and  give  Daniels’  results.  We  do  not  use  this  exact  method  in  our 
work  which  follows  in  Chapter  III. 

When  the  mean  is  unknown,  it  is  estimated  by 


x  1 

2  X,  +  X„  +  .  .  .  +  X  -  +  2 

1  2  n-l 


x 

n 


x 


n-l 


■  -  !  '0  3'JT  .  jj.  ,  ?,0\i 


'  j 


. 1  ■  . 


■  •-  o] :  3 lan 


■,  L  .  j 


+  ■  '  -i; 


j 

JL+1-- '  ' 


f  turn 


.  2  . 


IX  i'.l 


(l 


:  3  m  qj 

■'  T  .. 


O  •  ‘  ^ 

'  -fc  \1 :  '-■lived'  "ao:.. 

-  ----•  ■■  -  ■  :  ...  "C  S '  r’;  , .  ■  , 

'yjHsiii'if,  ai  :;.:c  .  T,row^  f-  ai  'iinof!,  .yrb  itariV? 


4- 


-f* 
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The  serial  correlation  coefficient,  p  ,  is  estimated  by 


r  = 


0 


where 


C  =  (x1-x)(x2-x)  +  ...  +  (xn_1-x)(xri-x)  =  c  -  (n-l)  x2  , 

c0  =  |(xrx)2+(x2-x)2  +  ...  +  (xn_1-x)2n^(xn-x)2=c0-(n-l)x2  , 


with  c  ,  c^  defined  as  in  section  3  of  this  chapter. 


The  joint  moment  generating  function  of  C  and  is 


.  T-C-+TC 

M(T0,T)  =S.(eUt  ) 


(i-ps)fc  r  r  toco+ic'2-'£  -  , 

- n  •••  6  dsl  ”•  dx„  > 


(at) 


2  -co  -oo 


-1 


where  C  is  given  by  equation  (2.3.2).  Since 


T  C  +TC-4  x'  C'1  x  =  T  c  +lc-i  x’  C'1  x  -  (n-l)  (l  +T)  xs 


i  (T0+T) 

=  -  2  x*  B  x  -  ^~Y~  x’  m  m*  x 


a(T  +t) 

=  -  2  x*  [B  +  p---- —  m  m*  ]  x  , 


with  B  given  by  (2.3.4), 


x' 


(x1;  ...i  \) 


and 


m 


(2,  1,  ...1  1,2)  ) 


.0  - 


U  &  ■  ■  >  ■&  o  d: 


;!  .  r:  ,'X 

-  ■  t; 


:  * 


•  L 


1  J 


vc  ar'  i' ;  f 
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we  have 


m(t0,t) 


00 

(1-Pa)2  J\ 
2  —00 


2(T  +T) 

00  1  ,rn  0  ,  t 

p  -2  x  LB  +  —  m  m  Jx 


dxx, 


.  .  ;  dx 


n 


(ac )‘ 


Then  we  have 


M(Tq,T)  =  (1-P2)2  |B  +  m  m*  | 


2(T0+T) 


-2 


which  is  obtained  in  a  manner  similar  to  equation  (2.5.5). 

2(T0+T) 

On  evaluating  |B  +  —  E  E*  I  and  raaking  the  necessary- 

substitutions  and  reductions,  we  obtain  the  following  approximation 


_  .  n-1  . 

after  omitting  a  term  m  z  . 


M(u-rT,T) 


(l-p2r(l-zgr(l-z)(l-2rz  +  z  ) 


n-1 
2 


(l-p){(l-pz)[l-pr-(r-p)z]-u(l-zg)](l-2pr+p£:;-2u) 


n-5 

2~ 


with 


x  [  ]  +  ( l+p)2(  l-2rz+zg)  [  ( z-p) ( 1-pz ) ( 1-r  )-t-u(  1-z2)  ]  j 

(n-l) ( 1-z2) ( l-2pr+p2-2u)  [  1-pr-  (r-p)z-u(  1-z2) ] 


1 

z  +  — 

z 


1  +  p2  -  2T 


0 


P+T 


_  2 


To  obtain  an  approximation  with  remainder  relatively 


0(n  ),  we  ignore  the  last  factor  and  we  take  the  dominant  term  as 

before  in  the  expansion  of  the  integral  for  h(r).  On  renormalizing, 
we  have 


1 

.2 , 


h(r)^KP-Pgr(^a)2  h-O  [l+o(n"2)]  , 


( 1-pr )( l-2pr  +  p2) 


9  'Sf. 
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where  K  is  the  normalizing  constant.  In  Leipnik's  form, 


with 


h(r) 


2 

— 


r(|)[N(i-p)-(i+P)] 


[I  +  0(; 


-i 


(l-2pr+p2) 


N-l 

2 


N  =  n  -  1  + 


roM 


-  '  ,  i;  :  •; 


[ 


■  .+ 


-  11 .  ' 
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CHAPTER  III 

DISTRIBUTION  OF  AN  ESTIMATE  OF  THE  SERIAL 
CORRELATION  COEFFICIENT 


1.  Non-circular  Markov  Process.  Known  Mean 

We  consider  a  non-circular  Markov  process  similar  to  that 
studied  by  Daniels.  As  given  in  [(2),  (5.5)3;  Daniels  takes  the 
sample  estimate  of  p  to  be 


r  =  — 


where 


'0 


c  =  X1  X2  +  •••  +  Xn-1  Xn  ' 


A  P  P  2  A  2 

cr  =  2  x,  +  X  *  +  .  .  .  +  X  +  2  X  , 

0  1  2  n-1  n 


whereas,  we  shall  take  the  sample  estimate  of  p  to  be 


r 


where 


c 


) 


(3. 1.1)  | 

I*  co 


A  2 

2  +  X1  + 


Xl£  +  •••  +  Xn£ 


A  2 

+  X  1  X  +  2  X 

n-1  n  n 


The  method  employed  in  obtaining  the  approximate  distribution  of  r 
is  similar  to  that  used  by  Daniels.  In  addition  to  discussing  the  case 
of  the  known  mean,  we  shall  discuss  that  of  the  unknown  mean  in  the 
following  section. 


The  joint  distribution  of  x^,  xr  is  given  by  equation 


it  -u  ’  r  :•(  t 
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(2.3.5)  and  the  sample  estimate  of  p  is 


r  = 


where  c  and  are  given  by  (3.1.1).  Then  the  joint  moment 

generating  function  of  c  and  is 

.  T.c  +Tc 

M(TQ,T)  =  &  (e  °  °  ) 


!_  00  00  1  -1 

(i-p2)2  r  r  Toco+Tc_2  -  -  - 

n  /  •••  /  e  dxl  ***  dXn  9 


(2  it) 


2  -00  -CO 


where  C  d  is  given  by  result  (2.3.2).  Now, 


T0c0+Tc-i  x*  C_1x  =  -  j  [(l-2T0-T)x12+(l+p2-2T0)(x22  +  ...  +  x2^) 

+(l-2T(.-T)xn2-2(p+T)(x]L  xg  +  ...  +  xn_i  xn)3 


where 


=  -  2  X*  D  X  , 


(3.1.2)  D  = 


1-2Tq-T 

-(P+T) 


-(P+T) 

l+p2-2T 


0. 


-(p+T) 


-(p+T)  l+p2~2Tr  -(p+T) 


(0) 


(0) 


l+p2-2T( 

-(P+T) 


-(p+T) 

1-2TQ-T 

/ 


n 


and 


X*  =  (xL,  ...,  xn)  . 
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Then 


m(t0,t) 


(1-P2)a 

(2,)1 


As  mentioned  in  Chapter  II,  section  there  is  an  orthogonal 
transformation  of  ,,0  x^  that  will  diagonalize  D.  Diagonalizing 

D  and  carrying  out  the  integration,  we  obtain 

(3.1.5)  m(tq,t)  =  (1-p zf  |£p 

where  ]d|  2  is  the  Jacobian  of  the  transformation. 

To  evaluate  |d(  we  proceed  as  followsl  (p+T)  is  factored 
from  each  row  of  |d|  and  the  following  substitutions  are  made! 


a 


> 


1  +  P2  -  2T 

b  -  pS - - 


so  that  |D|  may  be  written  as 


(3.1.4)  |d|  =  (p+T)"  Rn 

where  R  is  the  determinant 
n 


.. 


1  ) 


*)  ; 


:  ..  : 


.  -L  :  :  <j 


■  :  u: 


j; 


j  .  o 


yv 


■  ■* 1  -  *  ; 


i__l  '  / 
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‘  1  -1  .‘j  ’o  '  h  ;  . 
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R 

n 


a  - 1 

-1  b  -1 

-1  b  -1  (0) 


(0) 


b 

-1 


Let  R*  (j  <  n)  be  the  leading  principal  minor  of  order  j  of  the 

determinant  R  .  Then 
n 


(3.1.5) 


r  r* 


R* 


a  , 

ab-1 


and  in  general, 

R*.  =  b  R* .  -  R*  . 

J  J-1  J-2 

or,  equivalently, 

(3.1.6)  R*.  _  -  b  R*.  .  +  R*.  =  0  . 

j+2  j+1  J 

Taking  E  to  be  the  forward  difference  operator  of  the  calculus  of 
finite  differences  defined  by  equation  (2.3.6)  ,  we  may  write 
equation  (3.1.6)  as 

(3.1.7)  (E2  -  bE  +  1)  R*.  =  0  . 

J 

Solving  this  difference  equation,  we  find  that  the  roots  of  the 
auxiliary  equation 


z2  -  bz  +  1 


0 


:u.; 
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are 


and 


z  = 


b  +  -s/b2  -  4 


1  b  -  -s/b2  -  4 
z  “  2 


where 


(5.1.8)  z  +  “  =  t> 


Hence  the  general  solution  of  equation  (3. 1.7)  Is 


(3.1.9)  R*j  =  K1  zJ  +  Kg 


“J 


Applying  conditions  (3. 1.5)  to  equation  (3.1.9)  ;  we  have 


R*1  =  a  =  K  z  +  Kc<  2 


-1 


R* 


ab-1  =  ¥L  z2  +  %  z 


-2 


From  these  equations  and  equation  (3.1.8)  >  the  values  of  K-^ 
are  found  to  be 


K„ 


1-az 

1-z2 


K_ 


1 (a-z) 

1-z2 


Substituting  these  values  in  equation  (3.1.9)  )  we  have 


„„  tl-azs  j  rz(a-z)-,  -j 

R*  .  =  ( )  zJ  +  [— 51 ']  z  J 


l-zc 


l-zc 


But, 


and 


..  1  ii  j  ii  lO.axl 


4- 


ovr  u  j  / 


j  .fi'GJC  O 


•J  .<■  x  x iC'.j  ■  ,i.;.  ... 


A  + 


+  ; -  *  —  -  ”  ' 


*  I 


:  .  X .  ' ) 
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R 

n 


a  R*  ,  -  R*  0 
n- 1  n-2 


=  a  ((±=M)  s"'1  +  z^”-1)  ] 

1-z2  1-z2 


((iza£)  zn-2  +  j  2-("-a)) 

1-z2  1-z2 


or 


(3.1.10)  R  =  — - -  [z2(a-z)2  -  z2n"2  ( 1-az)2] 

n  z  (1-z2) 


Hence,  by  equations  (3.1.^-)  and  (3.1.10)  ,  we  have 


(3.1.11)  | D |  =  ...i-Ptll—  [z2(a-z)2  -  z2n"2  (1-az)2] 


’n(l-Z2) 


where 


a  = 


1  -  2T  -  T 

P+T 


b  = 


1  +  p2  -  2T 
_  ( 

P+T 


=  z  + 


Substituting  equations  (2.3.15);  (2.3.1?)  and  (2.3.18)  for 
u  ,  (p+T)  and  T  respectively,  we  see  that 


a  =  b  -  (£~^) 
V  p+T' 


z  +  z 


, p2+T  x 
'  p+T '  > 


Z(a-z)  .  1  -  ) 


(l-pz)(l-2pr+pz+p-z)-2u(l-z) 

l-2pr+p2-2u 


'SO 


\  1 


-  ■  o  *  /  1 


'  :i  .''/Oli  v 


i.t  , 

‘■+  . 

(  '  -  ' 


:■  -  g 


:  1)  .'J  U 
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and 


i  _  _  _ / P^+T \ 

1  -  az  =  z(TS)  ' 


(p-z)(p-2prz-z+pz-l)-2uz(l-z) 

l-2pr+p2-2u 

Then  equation  (3.1.4)  becomes 


|D|  _  ( l-2pr+p2-2u)n  j-  j-  (l-pz)(l-2pr+pz+p~z)-2u(l-z) jg 


( 1-z2) ( l-2rz+z2)n 


l-2pr+p  -2u 


z2n-2  j-  (p-z)(p  -2prz-z+pz-l)-2uz(l-z)  j 

l-2pr+p2-2u 


2n-2 

We  omit  the  term  in  z  within  the  bracket  which  gives  rise  to  an 

error  that  is  exponentially  small.  Hence,  on  ignoring  the  term  in 
2n-2 

z  ,  we  have 


|D|  CL~?-P„r.t.P  ~g:U) - -  [  ( l-pz)(  l-2pr+pz+p-z)-2u(l-z)]2 

( 1-z2) ( l-2rz+z2)n 


Thus,  an  approximation  of  M(Tq,T)  ,  as  given  by  equation 


(3.1.3)  ,  is 


(5,1.12)  M(u-rT,T) 


(l-p2)2(l-z2)2(l-2rz+z2) 


( l-2pr+p2-2u)‘"  [  ( 1-pz)  ( l-2pr+pz+p-z)-2u(  1-z)  ] 


-1 


Combining  equations  (3.1.12)  and  (2.3.21)  gives 

1 


n 


c)T 

M(u-rT,T)  —  ^ 

6z 


I  --2 

( l-p2)2( l-z2)2( l-2rz+z2)2 


n 

P 

( l-2pr+p2-2u)41  [  ( 1-pz ) ( l-2pr+pz+p- z  )-2u(  1-z )  ] 


-2 


and 


bar 
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^  [M(u-rT,T)  |j]‘ 


I  2  £_2 

( l-p2r(  l-z2)2( l-2rz+z2)2 


-1 


( l-2pr+p2-2u)  [  ( l-pz)(l-2pr+pz+p-z)-2u(  1-z)  ] 


f  i.  2(  1-z)  ( l-2pr+p2-2u)  •, 

n  +  [ ( 1-pz ) ( l-2pr+pz+p- z )-2u( 1-z ) ]  J 


Thus, 


8  [M(u-rT,T) 


OU 


I  1  £-2 

^  ( l-pg)2( l-z2)2( l-2rz+z2)2 

u=0  |-1 

( l-2pr+pg  f'  ( 1-pz ) ( l-2pr+pz+p- z ) 


x  [n  -  4  + 


2(l-z)(l-2pr+pg)  -j 

(l-pz)( l-2pr+pz+p-z) J 


By  equation  (2.2.2)  ,  we  have 

1 

/,  2^2  r  7T“2 

(3.1.13)  h(r)  -v - -  /  <p(z)  (l-2rz+z2)^  dz  , 

£_1  J 

2jti(l-2pr+p2)2 


where 


(3.1.14)  cp(  z) 


3 

(1-z2)2  r ,  1  f  2( 1-z) ( l-2pr+pg) 

( 1- pz ) ( l-2pr+pz+p- z )  1 '  n  ( l-pz)( l-2pr+pz+p-z) 


As  shown  in  Chapter  II,  section  the  transformation 


1 

z  +  — 

z 


1  +  p2  +  2rT 
P+T 


maps  the  T-plane  cut  exterior  to  the  interval  { 
on  the  real  axis  onto  the  interior  of  the  unit  circle,  jzj  =  1  ,  in 
the  z-plane.  Also,  the  path  of  integration  in  the  z-plane  crosses 
the  real  axis  at  z  =  p  and  terminates  on  the  boundary  of  the 
unit  circle  at  e  ^  and  e^  ,  where  r  =  cos  0. 


-(1+p)2  (1-P)2 

2(l+r)  5  2 ( 1 - r ) 


4]) 


[ 


'!  n- 


] 


J 


-J  ] 
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I  f  J 


•+ 


{.  "f 


.  .  [ 
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•' 1  . :  :  o; 


;i  jj  o 
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j  --  ; 


•  -  c; 


.  . 


The  real  singularity  arising  from 


1  -  2pr  +  pz  +  p  -  z  =  0 

is  the  only  possible  singularity  in  the  integrand  of  result  (3.1.13). 
On  the  real  axis,  we  confine  z  to  the  following  range  so  as  to  avoid 
this  singularity^ 

(i)  p<z<r,  p<r 


We  may  write 

l-2pr+pz+p-z  =  (l-p)(r-z)  +  (l+p)(l-r) 


Since 

|  p  |  <  1  and  1  r  |  <  1  , 

then 


1-p  >  0,  r-z  >  0,  1+p  >  0  and  1-r  >  0 

Hence, 

(l-p)(r-z)  >  0  and  (l+p)(l-r)  >  0  , 

and 

l-2pr+pz+p-z  >  0 
(ii)  r<z<p  ,  r<p 


Since 

z  >  r,  | p |  <  1  and  jr|  <  1  , 

pz  >  pr 

and  hence, 

l-2pr+pz  >  1-pr  >  0  . 

Also 


Then, 


p  -  z  >  0  . 


:i  :>  i . 
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l-2pr+pz+p-z  >  0 


(iii)  z  =  r  =  p 


Here , 


since 


l-2pr+pz+p-z  =  1-p2  >  0  , 


P  <  1  . 


Because  there  is  no  singularity  in  the  closed  interval  joining  p  and 
r  ,  we  may  deform  the  path  of  integration  in  the  z-plane  to  be  the 

mm  ^  Q 

straight  line  joining  e  to  e  and  crossing  the  real  axis  at 

z  =  r. 


As  in  Chapter  II,  section  3j  we  substitute  equation  (2,3.24) 
for  z  on  the  path  of  integration  so  that  equation  (3.1.15)  becomes 


1 

.2, 


n-  ^ 
2 


— _2 

x2 


h(r )  ~  . ^  ^■1~r  ^ — —  J  Cp(z)  (l-w2)"'  dw  . 

2*  (1  -  2pr  +  p2)^  _1 

Following  the  method  of  Daniels  ( 2  )  discussed  in  the  previous  chapter, 
we  expand  cp(z)  as  a  power  series  in  (z-r)  and  integrate  with 
respect  to  w.  By  using  equation  (2,3.24),  it  is  seen  that 

1  k  | 

cp(z)  =  cp(r )  +  iw(l-r2)2cp'  (r)  +  ...  +  1  -  i IrJ— L.  cp(k) 


(r) 


+  . . 


and  hence, 


n-jj 

2 


(3.1.15)  (lr  ..,  0 -'b  .  ^  iiig 

/,  «  ~  L  k=0 
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k 
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For  the  case  that  k  is  an  odd  integer,  the  integrand  is  an  odd 
function,  and  the  integral  vanishes.  Therefore,  we  may  write  equation 

(3.1.15)  as 


h(r ) 


2rt 


1  n-5 

(1-p2)2  (l-r2)  2 

2.-1 

(l  -  2pr  +  p2)*' 


k=0 


(-l)k(l-ra)k 

(2k)I 


n 


(2k)/  v 

cp  (r) 


2k/,  p\2 

w  ^1-W  ) 


dw. 


-1 


Since 

1  n 

T  F  2k  /  2%2  , 

1^  =  j  w  { 1-w)  dw 

-1 

is  the  same  as  equation  (2.3.28)  ,  the  value  of  I  is  given  by 
(2.3.29).  Substituting  this  value  in  the  expression  for  h(r)  ,  we  have 


I  2l5 
h(r)  ~  h.  a--pfl2hrrfl g 

'  2jt 


(l  -  2pr  +  p2) 
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|-1  w  ^ri  (2k):  [(n-l)...(nq2k-3)3 
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h(r)  -  UL_  ±dl±.  ^  {„(,)  +V  _(-Dk(l-r2)k  <£khri. } 

2n/*  „  S-l  r(^)  ^  2  C(n-l). . .  (n+2k«3)J 

(l  -  2pr  +  p2) 


Putting  z  =  r  in  equation  (3.1.14)  gives 

( 1-r2) 


2 

s2 


cp(r) 


or 


( 1-pr ) ( 1+p) ( 1-r ) 
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U  +  n  ( 1-pr )[ 1+p)  -  k]J 


(3.1.16)  cp(r)  =  (i.pr)('i+p|(i-r)  d  +  Ot"'1)]  . 


The  dominant  term  in  this  asymptotic  expansion  is  now  taken  as  the 
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asymptotic  value  of  h(r).  Thus,  to  0(n  we  have 

I  n-_2 

,,  2\2 /,  2\  2  r(~i) 

d-p  ) (i-*c).  _2__ 


h(r) 


-1 


(l  -  2pr  +  p2)' 


§-1  r(^) 


cp(r)  [1  +  0(n"  )] 


where  cp(r)  is  given  by  (3. 1.16).  As  we  are  neglecting  terms  which 


-1 


are  relatively  0(n  )  ,  we  may  write 


h(r) 


n 


r(f-i) 


1  n 

(l-pa)g(l-r2)2 


n-1  \  n 

( l-2pr+p2)c'  ( 1-pr )  ( 1-r )  ( 1+p) 


2^  r(~i)  ^  2J-i 


[1  +  0(n'i)] 


Using  result  (2.4.2)  and  following  the  discussion  of  section  4 
of  the  previous  chapter,  it  is  seen  that  h(r)  becomes 


h(r)  ^  K 


(1-r2) 


N+l 

2 


N 

2 


_  2 

[1  +  G(n  2)] 


( 1-r ) ( l-2pr+p2) 
where  K  is  an  adjusted  normalizing  constant  and 


N  =  n  -  1  + 


P 


l-pe 


To  renormalize  h(r)  we  consider 
1 


I  = 


(1-r2) 


N+l 
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( 1-r ) ( l-2pr+p2) 
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dr 
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( l-2pr  +  p2) 


N-1 

2 

IT 


dr 


f  (1  -  r2) 


N-1 

2 


N 


dr  + 


-1 


(l-2pr+p2) 


-1 


(l  -  r^) 


N-1 

2\  2 


N 

( l-2pr+p2)  2 


dr 


•»'•*■)  03  ,2jj 


:io: 


l  i  ,  t  1  ]  :: )  < 


j  ■ 


•! 


:KC  1. 


[  •"  '  + ..] 


(  VK  )  , 


+  :■:  '  •. 


...  I , 


s:  x: 


i-  i  . 


-»■  T '  '• 

[  +  •:■]  l;  - .  • 

1  ■  •  .  ’  . .  :  ’  •  )  ■  ;  •  . j  ■  ,  ; 


•-1-1-  ■  :.U 

'  1  )  :  :  . 


.  /  ■  ■ 


'  •  >-'■  .  >  -V 


i  .  J  "  \  "  * 


-  62  - 


Using  result  (2.4.4)  with  k  =  N  ,  we  have 


iL-ifi 


N-l 

2 


-1 


(l-2pr+p2) 
Integrating  by  parts  gives 


dr  = 


r(|+  i) 
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(l-r2) 


-1 
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dr 
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1  ( l-2pr+p2)^ 


dr 


Then,  by  result  (2.4.4)  with  k  =  N+2, 


J  = 


r(^±5) 

Np  n  x  K  2  ' 

(n+iT  r(|+2) 


Hence, 
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nTit  r(^) 


r  r.^+;x\ 
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/*  r(2±i) 
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[n( 1+p)  +  2]  . 


Then  the  renormalized  density  function,  in  Leipnik's  form,  is 


(3.1.17)  h(r)  -  K(n,p) 
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N  =  n 


1  +  i-p£ 


2.  Non-circular  Markov  Process!  Unknown  Mean 

For  the  case  when  the  mean  is  unknown,  we  estimate  it  by 

x.  +  . . .  +  x 

1  n 


and  the  serial  correlation  coefficient,  p  ,  is  estimated  by 


(J.2.1)  r  =  —  , 

C0 


where 


C  =  2(x1-x)^+(x1-x)(x2-x)  +  ...  +  (xn_1-x)(xn-x)+i(xn-x) 


—  \  l 


=  c  -  n  x 


(3o2.2 )/ 


c0  =  (xx"x)2  +  ...  +  (xn-x)2 


L  =  c0  -  n  x2 


with  c,  cQ  defined  by  (3.  l.l). 

Since  equation  (203„3)  gives  the  joint  distribution  of 
x^,  0  „ . ,  x^  and  equation  (3«20l)  the  sample  estimate  of  p  ,  the 
joint  moment  generating  function  of  C  and  is 
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-l 


where  C  is  given  by  equation  (2.3.2)  and 


x’  =  (xx,  ...,  \)  . 


Now, 


Vo+TC-^'c'lx 


x  =  T  c  +Tc-2X,C"1x  -  — —  (x  +  . 

—  00  - —  n  1 

x  (T0+T) 

-  2  X  D  X  -  ~ —  x'  1  1*  X 


(To+T) 


.  +  x  y 

n 


2(T  +T) 

=  -  2  X*  [D  +  - - —  1  1']  X  , 


where  D  is  given  by  equation  (3.1.2)  and 


1'  =  (1,  ...  ,  1)  . 


Then 


m(t0,t)  = 


(l-p2) 


1  2(T,+T) 

o  00  00  _L  «  rr\  0  ,  ,  , 

2  P  P  -2X1  [D  +  - -  1  1’  ]  x 


(2*) 


n  / 
2 


dx. 


Using  an  orthogonal  transformation  of  the  variables 
x^  . ..,  xn  ,  as  mentioned  in  section  3  °f  the  previous  chapter,  we 
2(T0+T) 

diagonalize  [D  +  — — -  1  .l*  ].  On  diagonalizing  this  matrix  and 

carrying  out  the  integration,  we  obtain 


2(T0+T) 


(3.2.3)  m(t0,t)  =  (1-P2)2  |d  +  —  ll'j 


t  I  “2 


2(Tq+T)  _i 

where  |D  +  - - —  1  1* |  2  is  the  Jacobian  of  the  transformation. 
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2(Tq+T) 

To  evaluate  |D  +  — - -  1_  JL'  |  ,  we  let 

a  =  1  +  p2  -  2TQ  +  |  (T0+T)  , 

b  =  f(T0+T)  -  (p+T)  , 

c  -  |(T0+I) 

and 

f  =  1  -  2Tq  -  T  +  |(Tq+T)  , 

so  that 


|D  + 


2(T0+T) 

n 


f  b 
b  a  b 

b  a  b  (c) 


(c) 


a 

b 


b 

f 


n 


2(T0+T) 

|D  +  - ^ —  1  1_*  |  is  the  same  form  as  (i.l) 

value  of  which  is  given  by  equation  (1.15). 


of  Appendix  I 
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we  see  that 
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(3.2.5)j 


U  = 


V  = 


+  \/s2  -  4r2 


=  -rz  =  ( p+r ) z  , 


s  -  \/  s2  -  4r‘~  -£  ( f)+T ) 

2  z  z 


and 


(3.2.6) , 


2r+s  = 


u-v 


-r 


t 


-  ?  (l-z2)  - 


(p+T)(l-z)a 

Z 


(p+tKi-z2) 

z 


Using  results  (3.2.4),  (3.2.5)  and  (3.2.6)  in  equation  (1.15), 

2(Tu+T) 

the  value  of  |D  +  -  1  1'  I  is  found  to  be 

2(1  +T) 

|D  +  - 11'  |  = 
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Dl  vj) 

Since  |z|  <  1  ,  terms  in  z  and  z  are  small  relative  to  those  in 
z  n.  Also,  terms  that  are  0(n  ^)  are  small  for  large  values  of  n. 
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2(tq+t) 

As  an  approximation  of  |D  +  - - —  _1  _!_*  |  ,  we  eliminate  these  terms 

and  obtain 


2(T n+T) 

(3.2.7)  |D  +  - 1  l'|  - 


(p+T)n"3 

zn(l-z2)(l-z)2 


{  [  z  (  p2+T  ) - ( P+T ) ] 2 [ ( p+T ) ( 1+z2 ) -2  z ( P-Tq )]} 


Substituting  equations  (2.3.  Ip)  and  (2.3.17)  for  u  and 
(p+T)  respectively,  we  see  that 


(p+T)(l+z2)-2z(p-T0)  =  (p+T)( l-2rz+z2)+2z[u-p( 1-r )] 

=  z(l-p)2 
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Then  equation  (3.2.7)  may  t»e  written 
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|D  + 


2(Tn+T) 


|  in  equation  (5.2.  j)  then 
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Combining  this  result  with  equation  (2.3.21)  gives 
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By  equation  (2.2.2)  we  have 
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,,  M  /  >  (l-zar(l-z)  ,1  ,  2(l-z)(l-2pr+ps)  _  n 

“( x-pz )  ( l-2pr+p2+p-z)  n  (l-pz)(l-2pr+pz+p-z)  y 


The  mapping  and  path  of  integration  in  the  z-plane  are  the 
same  as  in  the  cases  discussed  previously.  The  only  possible  singularity 
in  the  integrand  of  the  integral  for  h(r)  is  real  and  occurs  when 

1  -  2pr  +  pz  +  p-z  =  0  , 

By  confining  z  ,  on  the  real  axis,  to  the  following  range,  the 
singularity  is  avoided! 

(i)  P  <  z  <  r  ,  P  <  r 

(ii)  r<z<p,  r<p 

( iii )  z  =  r  =  p  . 

These  cases  are  discussed  in  the  previous  section  of  this  chapter  and, 
in  each  case,  it  has  been  shown  that 

1  -  2pr  +pz+p-  z>0. 

Hence,  as  before,  we  may  deform  the  path  of  integration  in  the  z-plane 
to  be  the  straight  line  joining  e  to  e1^  ,  where  cos  9  =  r  , 
and  cutting  the  real  axis  at  z  =  r. 

We  may  write  z  as  given  by  equation  (2„3,2h)  on  the  path 
of  integration  giving 
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Expanding  cp(z)  in  a  Taylor's  series  about  z  =  r  and  using  equation 
(2.3.24)  ,  it  is  seen  that 


cp(z) 


.1 

cp(r)+iw(l-r2)2cpl  (r)  + 


and  hence, 


1 

v2, 


-P  CO 

,2  ^  .k, 


k 

,2 


n- 


*«)-§;  tp(k)(r)  f^{l_wS)2  dK 


(l-p)(l-2pr+pa)  2  k-° 


-1 


As  before,  if  k  is  an  odd  integer,  the  integrand  is  an  odd  function 
and  the  integral  vanishes,  so  that  we  write 


n 


•2  0° 


h(r)  "  (l-pgf(l-r2f  V  (-.ljk.(l-rf£  (2k)(r)  fw2k(l.w2)  2 

2*  Hz2  L  (2k).  'J 


(l-p)(l-2pr+pa)  2  k  0 


To  evaluate 


n~!? 

w2k  (l-w2)  2  dw  , 


-1 


we  follow  the  method  used  in  Chapter  II,  section  3«  Letting 


w  =  u 


gives 


}  k-i 

r  *-2 


__  C" 

n-gt 

2 


(l-u)  c  du  =  P(k  +  2  , 


r(k  +  |)  r(^2) 

r(k  +  5-1) 


dw 


0 


■j ", 


r 


(•  )c 


.  ,  j. 


f 


i  M  ■>, 


~  i  )  ' 


("■ 


:  +:t :  ~j:)  - 
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Then 


r(h  r(2§2) 

for  k  =  0  ,  I,.  =  - 

0  r(S-i) 


'/x  r(^2) 
r(g-i) 


k  =  i  ,  q  - 


r(|)  r(2=5) 
r(|) 


=  — —  I 

n-2  0  ; 


k  =  2  ,  I_  = 


r(|)  r(^) 


2  r(|+i) 

and  in  general,  for  k  =  1,  2,  ... 


. x 

n(n-2 )  0  ’ 


( -z  p  t  _  1«3  •••  (2k*- 1)  y 

Ik  -  (n_2 )n  ...  (n-t2k-lf)  *0  ; 


where 


A  r(=§2) 

r(|-i) 


Using  equation  (3.2,9)  in  the  expression  for  h(r)  ,  we 


have 


n 


,  ,  \  n  (l-p2)  (l-r2)  T  r  /  n  \  (-1)  (l-r2)  (2k)/  x  ( 1.3. . . (2k- 1 ) ]  t 


(l-p)(l-2pr+p2) 


k=l 


or 


h(r)  „  ,JL_  ®  Mr)+y  (-»)!iO-cfj!!!(£l 

a/*  T(^-l)  ^  ^  2kk:[n-2)...(n+2k~ij.)] 


r(g-D 


(l-p)(l-2pr+p2) 


2/,  2x2 

2\  2 


}  . 


As  mentioned  in  the  previous  cases,  the  dominant  term  in  this  asymptotic 
expansion  is  taken  as  the  asymptotic  value  of  h(r).  Then  to  0(n  ^) 


we  have 


a  r. 


.j 


I 


U 


IS:  • 


Ji 


•i:q: 


ux 


) 


'i<  -r- j'O  ;L 


i.'.X.I 


3t  /.: 


■  03c; 
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(3.2.10)  h(r)'v 


-  i.  n_p 

r ( — t*-- )  (,  2\2/1  , 

n  2  ( 1- P  )  (l-i  )  /  \  n  n/  -1m 

—  — - —  v — 1 — - L — --=  q>(r)  [1  +  0(n  )] 


a/*  r(g-i) 


(l-p)(l-2pr+p2) 


n-J> 

2 


Putting  z  =  r  in  equation  (3.2.8)  gives 


2 

(  \  (l-rg)£  r i  1  r2(l-2pr+pg) 

l|>  1  “  (l-pr)(l+p)  +  n  (l-pr)(l+p) 


5]] 


or 


(3.2.11)  cp(r )  = 


1 

v2 


(l-r2)*"  f1  A/_-l\! 

(1-prKl+p)  [  +  (n  )] 


On  substituting  equation  (3.2.11)  in  equation  (3.2.10)  we  obtain 
the  following  approximate  value  of  h(r)  * 

n- 1 

[1  +  0(n-1) ] 


h(r) 


_n_  r(^2) 


(1-r2)  2 


It  r,/n 


n-3 


r^2"1^  (l-p2)2(l-pr)(l-2pr+p2)  2 


since  we  neglect  terms  that  are  relatively  0(n  ^'), 


By  the  method  used  in  Chapter  II,  section  3?  it  is  seen  that 
h(r)  becomes 


h(r)  -  K  — h-.ra). [1  +  0(n  2)]  , 

(l-2pr+p2) 

where  K  is  an  adjusted  normalizing  constant  and 

2 

N  =  n  -  1  +  -£ — 

1-p2 


To  renormalize  h(r)  ,  consider 
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2\ 2 


I  = 


(1-r2) 


dr 


N-l 

1  ( l-2pr+p2) 

1  ** 

f  (l-r2)2(l-2pr+p2) 
N+l 

(l-2pr+p2)  2 


dr 


-1 


=  (l+P2) 


(1-r2) 


N 

2\2 


N+l 

_1  (l-2pr+p2)  2 


dr  -  2p 


J 


(l-rg) 


N 
a\2 


( l-2pr+p2) 


N+l 

2 


With  k  =  N+l  in  equation  (2.4.4)  ,  we  see  that 

1  § 


(1-r2) 


-1 


( l-2pr+p2) 


N+l 

2 


dr 


■Vi  r(|  +  i) 
r(S-f^) 


Integrating  by  parts  and  using  equation  (2.4.4)  with  k  =  N+3 
gives 

N  i 


Then 


r(l-r2)2 


N+l 


dr 


J 

_1  (l-2pr+p2) 


p(N+l) 

(N+2) 


(1-r2) 


^+1 

2+i. 


J  N+5 

~l  ( l-2pr+p2)  2 


N 


_  dr 


p/jt  (N+l)  r^2  + 


(N+2) 


r(^p) 


i  =  (i+p2)  [ 


0  rP^(N+i) 


n+3\  "  2p  [~WT 


r  (=|2) 


r(2±S) 


r<l+1) 

a  r(S_±_5) 


[(i-p2)(n-i)  +  4]  . 


Thus,  the  renormalized  density  function,  h(r)  , 


dr  . 


in  Leipnik's  form  is 
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where 
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N 

.2x2 


.  1 


[1  +  0(n  2)]  , 

( l-2pr+p2)  2 


K(n,p)  =  y  =  -p 


r(^) 


/it  r(|fi)[i-p2)(N-i)+4] 
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CHAPTER  IV 

THE  APPROXIMATE  DISTRIBUTION  OF  A  RATIO  OF  THE 
SQUARE  SUCCESSIVE  DIFFERENCE  TO  THE  SQUARE  DIFFERENCE 


We  are  interested  in  obtaining  the  approximate  distributions 
of  the  statistics 

n- 1 


Z  (x  -  x. )2 
'  l+l  l 


D  = 


i=l 


Z  x. 

i=!  3 


and 


n-1 

Z  (x  -  x.  )2 
D  =  i=l  1 


n 


Z  (x.-x)2 
i=l  1 


where 


n 

Z  x, 


x  = 


i=L 


n 


As  mentioned  in  Chapter  I  these  statistics  are  similar  to 


s 


where 


and 


n-1 

Z  (x  -  x. )2 

.  1  i+l  i7 
.2  1=1 

5  =  - ^1 - 


n 

Z  (x.  -  x)‘ 

•  i  '  l 

,2  1=1 


n 


when 


n  is  large,  D  is  the  case  where  the  mean  is  known,  and  is 
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the  one  where  it  is  unknown  but  estimated  by  x.  We  assume  that  the 
sample  consists  of  serially  correlated  rather  than  independent,  normal 
random  variables. 


Let  us  first  consider  the  distribution  of  D.  We  see  that 


r  = 


1  -  2  D  ' 


where 


r  = 


'0 


with  c  ,  c^  given  by  (5.1.1).  Then 


g(D)  = 


\  h(r) 


r  =  1  -  -  D 


so  that,  using  equation  (3.1.1?)  , 


N- 1  N+l 

g(D)  K(n,p)  — - - -  [l  +  0(n  2)] 

2N[(l-p)2+pD]  2 
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As  r  ranges  from  -1  to  1  ,  D  ranges  from  0  to  4, 

To  obtain  the  distribution  of  ,  we  use  the  density 

function  h(r)  as  given  by  equation  (3.2.12)  ,  since 


r  “  1  ”  2  D1  ' 


where 


r  = 


with  C,  Cq  given  by  (3.2.2).  Hence, 


g(Dl)  =  \  h(r) 


r  ~  ^  "  2 


giving 


or 


where 


N  N 

D  2  (4-D  )2  _  2. 

g(D1)  K(n,p)  - - - [l  +  0(n  2)] 

2N  [(l-p)2+pD1J  2 


N  N  /N-lv  3 

O  p  P®i  ”  ‘V  p  J  ~  Q 
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Here  also,  D.^  ranges  from  0  to  4  as  r  ranges  from  -1  to  1. 


Now,  we  shall  show  that  the  moments  of 


4 . 1:1  'v  -  v 


n 


“  \2 


z  (x.-x) 

j=l 


and  the  mean  value  and  variance  of 


V  = 


n  A 
n-1  B 


obtained  by  Williams  (lo),  are  approximately  the  same  as  those  we 

obtain  from  the  density  function  of  with  p  =  0.  Let  ra,  denote 

ttl 

the  k  moment  about  the  origin.  Since  equation  (3.2.12)  is  the 
renormalized  density  function  of  r  and  that  of  is  obtained  from  it, 

mo  =  1  • 

Using  the  density  function  of  with  p  =  0  ,  we  see  that 


4  n+1  n-1 

!  =  Kg(n,0)  /  D1  2  (4-D1)  2  , 

0 


m 


where 


K„(n,0)  = 


r(|+2) 


2n-V„  (n+£)  r(2|l) 


Putting 


=  Ax  gives 


m. 
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“A  (n+2)r(2|i)  - 


1  n+1 
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dx 
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=  2n+?  r(§^)  (2±5  n+l 

(n+2)r(2±i)  2  ’  2 

2n+?  r(|+e)  r(^5) 
s/it  r(n+3) 


By  [(15  )>  Pase  24o], 


m 


2n+^  r(|+2)  r(^~p) 
1  2n+2  F(g+2)  r(2|2) 


=  2 


Similarly, 


m. 


4(n+3) 

n+2 


and  m. 


8(n+3) 

n+2 


Now,  m^  and  m^  are  the  same  as  the  corresponding  moments  obtained 
by  Williams  [(lb),  ( 10 ) ] .  Also, 


1.  i 

m2  =  4[^23 


=  4[1  +  -  -  -  +  oCn"-^)]  , 


n  n2 


and  since  Williams*  value  is 


ITU 


4[ 


n2+n-3  1 

(n+l)(n-l) ^ 


=  4[1  +  - 

n 


~  +  0(n"')]  , 

n2  { 


the  second  moments  about  the  origin  are  the  same  to  0(n  '  ).  In  a 
similar  manner,  we  see  that  the  third  moments  about  the  origin  are 
the  same  to  0(n  J),  Hence,  for  large  values  of  n  these  moments  of 
D  with  p  =  0  are  similar  to  those  of  —  as  obtained  by  Williams,, 

1  IJ 

We  can  show  that  this  is  also  the  case  for  higher  moments  as  well. 
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Considering  the  moments  m^  and  m0  of  with  p  =  0  , 
as  obtained  above,  we  see  that  the  mean  value  is  2  and  the  variance 
is 


Variance  =  m0  -  (m^)2 

_4_ 

“  n+2 

The  mean  value  of  f\  is 

2n 

n-1 

In  his  paper  Williams,  [ ( lo ) ,  page  24l],  has  given  an  incorrect  value  for 

A 

the  variance  of  r).  Using  the  moments  m.  and  of  —  obtained  by 

Williams,  we  see  that  the  correct  value  of  the  variance  of  q  is 

4n2(n-2) 

(n+l)(n-l)‘ 

For  large  values  of  n  the  mean  of  q  is  approximately  2  and 
therefore  similar  to  our  value.  Since 


and 


4n2(n-2) 

(n+l)  (n-l)- 


*[  £  +  0(n'  ')] 


_4_ 

n+2 


4[i+0(n'2)] 


for  large  values  of  n  the  value  of  the  variance  that  we  obtained 
and  the  one  obtained  by  Williams  are  approximately  equal.  Thus  we 
see  that  for  large  values  of  n  the  distribution  of  with  p  =  0 

is  approximately  equal  to  that  of  q  discussed  by  von  Neumann  (10), 
(ll)  and  Williams  (lo). 


..  . 


-  81  - 


APPENDIX  I 

EVALUATION  OF  A  DETERMINANT  WHICH  IS 
FREQUENTLY  ENCOUNTERED  IN  STATISTICS 


We  are  interested  in  finding  the  value  of  a  determinant  of 


the  form 


(I.D 


f  b 

b  a  b 

b  a  b 


(c) 


The  technique  of  evaluating  determinants  by  difference  equations,  used 
here,  is  due  to  Dixon  (5). 


Replacing  f  by  [a  +  (f-a)]  in  (1.1)  ,  we  obtain 


(1.2)  A  =  E  +  2(f-a)  E  -  +  (f-a)2  E  0  , 

n  n  N  '  n-1  '  n-2 

where 


E 

n 


a  b 
b  a  b 

b  a  b 

o  • 

(c) 


(c) 


a 

b 


E 

n 


E  of  (4.10) 
n 


The  determinant  above,  denoted  by 


is  the  same  as 
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of  Dixon’s  paper  (3).  Equation  (4.2.3)  of  (3) 


(1.3)  E  =  H  -  c  I 
n  n 


n+1 


where 


H  = 
n 


s  r 

r  s  r 

r  s 


(0) 


(0) 


and 


r  =  b-c  s  =  a-c  , 


I  = 
n 


0 

1 

1 


1  . 

r 

s  r 

r  s 


(0) 


(0) 


As  shown  in  (3) »  the  value  of  H  is 
7  n 


(1.4) 


n+1  n+1 

u  -  v 

u-v 


where  u  and  v  are  the  roots  of  the  equation 


2  2 

x  -  sx  +  r 


0 


Then 


(1.5)  u  +  V  =  s 
and 

(1.6)  uv  =  r2  . 


The  value  of  I  is  obtained  by  solving  the  difference 


equation 


(1.7)  In-s  In_x  +  r2  In_2  =  (-l)n_1(Gn_1+  r  Gn_2)  ,  [(3),  equation  (4.27)] 


where  the  value  of 


G  = 
n 


(0) 


(0) 


•  • 


r  s 
r 


,  [(3),  (4.16)]  , 


IS 


n  .  /  n  n>.  n+1  n+1 

(1’8)  Gn  =  2r+s  +  [  "~T^)Tgr'^f -  1  ’  !(5)’  equatlon  (4'20)i 

Equation  (1.7)  is  equivalent  to 


(l-9>  W  -  S  Vl  +  rS  <Gn+l  +  r  Gn>' 


Letting  E  be  the  forward  difference  operator  of  the  calculus  of  finite 
differences  as  defined  by  (2.3.8),  equation  (l.9)  may  be  written  as 


'.rv;!T 


Lj 


•-  ■■  i  s  :  gnivi'oa  >  I  a  _.  . 


WJ’i.D 


XI  <J 


.)] 


"  ■■  i 

<.  s  .  JL  -f  . 


1  ■ 


[ .  ...  :  *■;  ;i  , 


■  ) 


o  3  ir.v  Zi  ,.i.i  r 


r  I 
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/]  *  [ . 
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c  ;!  . .  :  .  I )  i 


'j  ) 

i-H. 


j:  ^  +  :+ 


i 


. 


;i  i, 
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n- 1 


(E2  -  sE  +  r2)  =  (-1)  (G  +  r  Gj  . 


n 


n 


Now,  using  equations  (l.5),  (l.6)  and  (l.8)  ,  we  have 


n+1  /  n+1  n+l\  n+2  n+2 

«  p  [r  ,  /  i^n  r  r(u  -v  J+u  -v 

Gn+l+r  Gn  +  !  (u-v)(2r+s) 


]} 


n 


_  /  n  n\  n+1  n+1 

+  r  {_£_  +  (-l)11'1  rBu-  "YJ-t“ _ =2 _  1} 

+  l2r+s  1  '  1 (u-v) (2r+s )  JJ 


0  n+1  i  .  vn  /  n+1  n+1  >. 

2r  +  (-1)  (u  +  v  ) 

2r+s 


Hence,  we  wish  to  solve  the  difference  equation 


0/  \n+l  /  n+1  n+1 » 

(1. 10)  (E2-sE+r2)  I„  =  iLlEl - ! — -±-S - ) 


n 


To  obtain  the  complementary  function  of  equation  (lo10)  we 

consider 

(E2  -  s  E  +  r2)  I  =  0  . 

'  n 

The  corresponding  auxiliary  equation, 
x2  -  sx  +  r2  =  0  , 

has  roots  u  and  v#  Then 

In  .  KlUn+Ksvn 

is  the  complementary  function  of  the  complete  solution  of  equation  (i 
The  particular  integral  is  obtained  as  follows?  We  assume 


10). 


a  solution  of  the  form 


*  ■  ■  H- 

n 


, 

1+ 


'•up* 


to  i 


[ 


] 


~h 


■‘lOilii  "  ,  o.'.Mi; 


c 1 1  a . 


OJ  f  > 
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0  7 
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( 1. 11 )  I  =  A(-r)U+1  +  Bnun  +  Cnv'1 


Using  equations  (l.5)>  (l.6)  and  (l.ll)  in  equation 
have 


(E2-sE+r2)  Xn  =  -A(2r+s)(-r)n  +B(u-v)uT1+i-C(u-v 


\n+l  /  n+1  n+1 . 

2(-r)  -  (u  +  v  ) 


2r+s 


Equating  coefficients  gives  us 


A  = 


r(2r+s  )2 


,  B  = 


-1 


(2r+s )  (u-v)  ;  C  (2r+s)(t 


Then  equation  (l.ll)  becomes 


T  gC-l)11"1  r"  r  un-vn  . 

*n  /«  .  "  n  (u-v)(2r+s )  J 


(2r+s  )‘ 


and  the  complete  solution  of  equation  (i.lO)  is 


rx!  ..  \n-l  n  n  n 

T  „  n  „  n  2(-l)  r  r  u  -v  n 

(1.12)  I  =  K  u  +  K  v  +  — - — - n[7 - 777: - -] 

n  1  2  (2r+s)2  (u-v'"3"  ■ " ' 


-v)(2r+s) 


and 


Knowing  that 


h  -  0 


h  -  -1  - 


and  using  equations  (l.5)  and  (l.6)  ,  we  can  solve  for 


o10),  we 


\  n+1 

)v 


-v)  * 


and  Kc 


in  equation  (l,12).  Thus 


s 


r.c ; 


c-n. , 


tV 


i.  ).! 


■i 

n 


if.  i ;  >:i  ..a 


1  , 


I 


'lua  il.  :-  r 


.a/; 
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f  ll  =  o  =  Klu  +  KgV  - 


(1.13) 


(2r+s); 


V*  h 


-  1  =  K,u2  +  KpV2  -  ^ 

<=-  r*  \2 


(2r+s) 


Solving  (I.I3)  for  and  K0  ,  we  obtain 


K. 


1  (2r+s); 


*2  ’ 


(2r+s  )c 


so  that  equation  (1.12)  becomes 


n  n  - vn-1  n  n  n 

/ T  1 1,  \  T  u  +v  +2(-l)  r  r  u  -v 

n  ”  (2r+s)2  '  "  (u-v)(2r+s) 


Using  equations  (l.4)  and  (l.l4)  in  equation  (l.j), 


value  of  E  is  found  to  be 
n 


n+1  n+1  n+1  n+1  _/  .  Nn  n+1  n+1  n+1 

E  =  S - IV - c  (  U  -hv  +4-1 )  r - (n+l)  [  U  -v -  ]  ■ 

n  u-v  (2r+s)2  (u-v)(2r+s) 


n+1 


(u-v)(2r+s)c 


{ (2r+s )2-c [ (u-v )- (n+1 ) (2r+s ) ] } 


n+1 

- - - ^  ( (2r+s )2+c [ (u-v )+(n+l ) (2r+s ) ] } 

(u-v)(2r+s)2 


2  c(-r ) 


n+1 


(2r+s  )‘ 


Substituting  this  value  of  in  equation  (l02)  and  collecting 


the 


terms ,  we  have 


I 


I  o  o 
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(1.15) 


+ 


where  u 


and 


n-1 

A  =  - - -  { [u+(f-a)]'>[(2r+s)'->-c((u-v)-n(2r+s))] 

n  (u-v)(2r+s)2 

+  c(2r+s)[u2-(f-a)2]} 

n-1 

- — -  { [v+(f-a)]2[(2r+s)a+c((u-v)+n(2r+s))] 

(u-v) (2r+s )2 

+  c(2r+s)[v2-(f-a)2]} 

[r  -  (f-a)]2  , 

(2r+s)2 

and  v  are  the  roots  of 


x2  -  sx  +  r2  =  0 


=  b-c. 


r 


s 


a-c 


)]  ■[ 
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